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INTELLIGENCE EXAMINATIONS FOR 
COLLEGE ENTRANCE! 
EpwaArp L. THORNDIK! 
Teachers College, Columbia Univer 
For an ideal examination of the intelligence of candidates for 
leve entrance we might set the following specifications: 
| Significance. The score should correlate as closely with 
future achievement in college as is possible. This maxi 
mum possible correlation will not be 1.00, since achieve 
ment in college is due in part to health, to freedom from 
personal worries, and to various moral qualities as well as 
to intellect. Also, the magnitude of the correlation co 
efficient will depend on the range of the intellect of candi 
dates, being smaller as that range is restricted. If all the 
eighteen-year-olds in the country were educated for college, 


tested. and given a trial in college, we might perhaps 


expect a maximum correlation as high as 0.75 to 0.85 
Within the restricted range of those who complete a high 
school course and actually become candidates, we may 
expect as a maximum 0.55 to 0.65, possibly more. A 
correlation above 0.50 is probably an improvement over 
the attainment of standard systems of accrediting high 
schools or of entrance to college by examination in school 
subjects. 

II. Continued significance——The correlation should maintain 
itself year after year after the nature of the intelligence 
examination is known in spite of whatever coaching 
candidates undertake. This implies, in theory, that such 
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special coaching shall give training that is nearly as us 
future college achievement as for success in the test 
the tendency to undertake, and the ability to pr 


suc h sper ial coat hing shall be very closely corre] ite 


ability to achieve in college. In prac tice, it mean: 


the examinations year after year should be totally di 


in content until a great many of them are availa! 
should differ in form where there is danger that ad 
to the form of the examination may enable a dul 


secure a good score. 
III. Comparability of standards and results.—(a) The ex 


tions given year after year should be closely ¢ 
difficulty; (b) the scoring should be by standard |} 


that the same paper scored by different examiners y hig 
receive substantially the same score; (c) the admi 
tion of the examination should be simple and indepe: g 
of the personality of the examiner 
IV. Probable error of the examination itself-—For the examina gra 
tion’s main purpose, the probable error is already t 
account of in the correlations with college success. | 
that purpose, in fact, a large probable error w the 
encouraging, for it would mean that by repeatir il 
examination, using a different form, the correlation wit I 
college success could be notably raised. For certain sp ' 
purposes such as comparing individuals or groups, and 0.5 
the justification of shortened forms of the examinati TI 
smaller the probable error the better. ire 
A half-year’s experience with the Thorndike Intelligence Ex fr 
ination for High School Graduates may increase our confiden ma 
that these specifications may be met to a rather close approxima Sut 
tion. This examination was devised at the request of the fa 
of Columbia College, where it is an optional means of entranc 
boys suitably recommended. Three forms of it have been us wae 
date by Columbia, one in June 1919, one in September 1919, and Pe 
one in February 1920. About seven hundred candidates ha ir 
taken it, though over half of these were already legally admitt "ace 
by the content examinations of Columbia University o: ( 
College Entrance Examination Board or the New York Reg: . 
It has also been used for various purposes by a number o! is 
pe 


institutions. 
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SIGNIFICANCE 

Four years must elapse before an exact accounting on this 
t can be made, but the following facts may be noted: 

Of eleven boys at Columbia, reported to the dean’s office for 
ility to do college work in the early weeks of the year, all had 
ibly low scores in the intelligence examination. Of a score or 

so reported as a result of the mid-term records, all but two 
| low scores. The defective college work of these two was by 
mmon consent not due to intellectual defect. 

In the case of a group of eighty odd candidates in another 

lege, the correlation between the score in the Thorndike 

ination and the first term’s college record was over 0.65. 

e highest 40 percent in the examination showed 74 percent of 

gh grades in college work and 26 percent of low grades. The 


vest 60 percent in the examination showed 27 percent of high 


les and 73 percent of low grades. Of the 16 percent receiving 


the lowest grades in the examination, none received any college 
grade above C and 86 percent failed in five hours or more of their 
llege work 


r In a third institution, where the entire student body was tested, 
the members of the three upper classes showed no scores below 60 
in the examination, whereas a third of the freshmen (admitted by 

ertificate) scored below 60. The distributions given in the 
accompanying table (Table I) give a correlation of approximately 

0.55 between test score and continuance beyond the freshman year. 

The returns received from the first and third of these institutions 

are a random selection from trials of the examination. Those 

from the second institution were reported to the writer. They 
may have been reported because of the positive evidence of the 
success of the examination, and so may be unduly favorable. 
CONTINUED SIGNIFICANCE 

If we take the best of the test material that has demonstrated 
high correlations, such as selected series of opposites, mixed rela- 
tions, and cleverly devised problems and completions, and give it 
without fore-exercise, we can undoubtedly get high correlations, 
but we may be unable to maintain them. 

Our opposites, relations, and problems of later years will prob- 
ably not be so ingenious as those which we chose first. Moreover, 
part of the first high correlation may have been due to the testing 
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TABLE I. THE IN PERCENTAGES, OF STUDENTS 
A WESTERN PROFESSIONAL SCHOOL IN THE THORNDIK! 
INTELLIGENCE EXAMINATION FOR HIGH 
SCHOOL GRADUATES 


SCORES, 


dmits on certificate from accredited s 


that a considerable percentage of the students so admitted do not 
rds, the elimination being rather large. The figures below 
in lity denoted by a score of 60 or more in the T! 
examination is required for meeting the standards of this institutio1 
of the sophomores, juniors, and seniors fall below 60, whereas about o 


2 
| 2 
10 12 
45 2. 
50 2 
55 10.3 | 
60 15.4 5.5 
65 | 10.3 16.3 
70 12.9 10.9 
75 5.1 8.1 
80 7.7 19.0 
85 10.3 10.9 
7.7 8.1 
os 10.9 
100 
105 0 
110 0 
115 2.7 


of ability to understand quickly the nature of the tasks. Wh 
the nature of the examination becomes a matter of public know!- 
edge to candidates, the best features of it may be lost. It wi 
specially disastrous if some candidates do and others do not kn 


about it. 

Consequently, thorough precautions must be taken so tha 
examination will be as effective for twenty years as it is in its | 
trials. Our precautions are: 
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\]l test material is made up in quantities sufficient to pro- 

r the entire series of examinations into which it enters, and 

ributed without prejudice among them.’ The selection for 

September 1929 will be nowise inferior to the selection for Sep- 
r 1919. 

lhree-fourths of the candidates’ time is spent on paragraph 

completing sentences, tests of information, arithmetical 

gebraic computations and problem solving, common-sense 

ions, and following directions. The nature of these tasks is 

rstood in a second or two by everybody of the intelligence 

fa high-school graduate. In examining hundreds of papers, 

| have never seen a case of misunderstanding a single one of these 


3. With two exceptions,’ fore-exercise is given for the other 
and two trials at each task are allowed. They include such 
as the disarranged sentences, opposites, number-series com- 

tions, verbal analogies, pictorial analogies, geometrical rela- 
, and absurdities. The nature of these is, in general, such 
any unfair advantage to a boy whom some unscrupulous 

r might train in test-taking would be slight. Experiments 

re planned to measure this gain exactly. If it is appreciable, the 

examination will be extended to include “traps” to penalize such 
proper preparation, 

t. The content of the examination is entirely different in each 
issue. The form of the examination in the case of those tests 
where an unfair advantage from coaching is a possibility, will 
change every two or three years. 

5. Finally, no new issue will be used regularly until it has been 
tried out sufficiently to insure its giving a prophecy substantially 
equivalent to the previous issues of the examination. 


COMPARABILITY OF STANDARDS AND RESULTS 

Since each element of the examination is selected at random 
as to difficulty, the total examination, comprising over twenty 
lifferent tests, will in any one issue of the same general type, be 
closely equal in difficulty to any other (with the exception of the 
This is not true of the June 1919 series, which had to be arranged in part before 

tal material could be planned. 
[In the later series it is planned to provide fore-exercise for these, if any evidence 
rs that it is needed to equalize matters for those who have and those who have 


t previous acquaintance with the examination. 
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June, 1919 series which, for the reason given above, could not | 
fully standardized and is in part somewhat harder than 
others). Each issue is further checked in this regard by 
trial For example: 

Eighty college students took Forms A and F, Part I, of the ex 
amination in that order. Eighty others took Forms A and G jy 
that order. Letting a=score in A, f=score in F, and so on. we 
find that Median of (f—a)=Median of (g—a)+1. That 
Form G is 1 point, or less than 1%, harder than Form F. 

Thirty-six college students took Forms A and H in that order 
Median of (h—a)= Median of (f—a)+1%. That is, Form F 
11% points, or a little over 1%, harder than Form H. 

One hundred fifty-four college students took Forms A and J in 
that order. Median of (j—a)=Median of (f—a)+2. That i 
Form F is 2 points, or about 12g% harder than Form J. 

Thus f=g+1=h—1%4=j—2 

Part II Form B and Part II Form C were each given to §3 
college students, the two groups of 85 being random halves of a 
group of 170. The two groups were tested at the same time in the 
same room, by the same examiner, all instructions being identical 
The median score for Form B was 81.5; for Form C, 79.0 ora 
difference of 2.5. The 25-percentile score for Form B was 58.3 
for Form C 57.5 or a difference of —0.8. The 75-percentile score 
for Form B was 102.7; for Form C 101.9 or a difference o/ 
—0.8. In general, the two distributions are closely similar. 

We may, therefore, conclude that Part II C is probably a trifle 
harder than Part II B (about 1% percent).* 

Thirty-three college students took both III B and III C, sixteen 
having one form first and seventeen having the other form first 
The median of (c—b)=1) points or about 2% percent. 

Two examinations made up respectively of: 

IG I J Il B and III B 
IF IH IC and III C 
would thus be almost exactly equal in difficulty for a college group 

Twenty-three adults took both II B and II D, twelve having 
Form B first and eleven having Form D first. The median 
(b—d)=4. That is, Form D is 4 points harder than Form B 


‘Test 7 was omitted in both cases, but we know from other evidence that II B/ 
and II C 7 are very closely similar in difficulty. 


~ 
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So, when II D is used in place of II B or II C, the other parts of the 

examination should be chosen to be a trifle easier than I G, I J, 
B, vw IF, 1H, IC. 

difference in difficulty between any two issues can thus be 

ind allowed for by transmuting the score, or, if it is at all 

ge, it can be reduced by alterations in the examination and re- 


a: cking. This process of equalization can be applied to the 
4 percentile or 20-percentile or any other ability levels as well as 
the general tendency of the group. 
rm [his checking is extremely laborious and probably unnecessary, 
Fi differences of 3 and 4 or even of 5 and 6 percent 
the difficulty of different issues are of little practical conse- 
I in uence in any uses to which the examination is likely to be put. 
“$F However, their reduction to small amounts and an exact knowl- 
edge of these amounts make an instrument available for very 
precise comparisons. 
y 85 [he scoring of all save the reading and completion tests is, 
with very slight exceptions, done by absolute keys with no re- 
‘ juirement of judgment on the part of the scorer. The scoring of 
the reading and completion tests requires some judgment in the 
; f the keys, but the correlation between the ratings given by 
yh two scorers of the ability of a college instructor or assistant is 


very high. The correlation between two such scorers is 0.98. 
The probable difference between two such scorers was found to be 
nly five points out of a total score which ranges from 7 to 96 
a. zmong the actual candidates whose papers were scored. These 

rers "ised only the stock keys supplied with the tests. By 
having one person score one test of the six, another score another, 
ind so on, the probable error for the total result of one such group 
of six would obviously be unappreciable. This is the practice rec- 
ommended where the examination is used with groups of any con- 
siderable size. 

The administration of the examination consists simply of giving 
out the blanks, and instructing the candidates to go ahead at 
certain times even if they have not finished the work to date. In 
general, a candidate does test after test without awaiting instruc- 
tions. 


IMPROVEMENT OF THE EXAMINATION 
B? As soon as adequate records of success in college are available, 
the correlation of each element of the examination therewith will 


€ ex. 
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be computed together with the partial correlations where th 
instructive. In the meantime, data are being gathered . 
ing the value of different available tests as shown by th 
relations with a composite score obtained in seven or eight 
of work by adults of the general intelligence level of « 
candidates. Some of the data so far obtained are of \ 
anybody who is working with group tests for adult intelli 
and are presented here. Lack of space forbids adequate des 
tion of the tests. The following definitions apply to capti 
appearing in Tables II and III. 
1. “Part I (first half)” means the first 30 minutes work of the 
standard examination as now given. 
“Part II”’ means Part II of the standard examination 
“Part IIL’ means Part III of the standard examination 
‘“‘New Part I (first half)’’ means a new form of Part I to g 
into effect in 1922. 
“Information” means a test of the type used in the Arm 
Alpha, but harder. 
“Name part”? means a test in writing a word that m 


part of the thing named by the given word, and also begins 
with a certain letter. 


“Name opposite” means a test in writing a word that m 
the opposite of the given word, and also begins wit 
certain letter. 

“Name thing of which is part”’ means a test in writing a word 
meaning something of which the thing named by the gi 
word is a part. The word written must also begin wit 
a certain letter. 

“Name thing made of,” “synonyms” and “species of genu 
are like the above. The word written has to fulfill ther 
quirement of being in the stated relation to the given wo 
and also of beginning with a certain letter. 

“Sum, difference, product” means a test in giving 
numbers which are defined by certain relations (e.g. tv 
numbers whose product is 1 and whose sum is 2). 


\ 
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II. CORRELATIONS OF VARIOUS FORMS OF GROUP TESTS 
OF ADULT INTELLIGENCE LEVEL WITH A COMPOSITE 
SCORE FOR SEVEN HOURS OF TEST WORK, IN 
THE CASE OF 33 COLLEGE STUDENTS 


Time in Correlation 
Test Minutes | 
t I (first half) 30 0.75 
I 60 0.85 
40 0.65 
ae 120 | 0.81 
rt I (first half) 30 0.84 
tion | 15 0.62 
rt 8 0.40 
posite 12 0.80 
g thing of which is part 13 0.72 
Name thing made of 1314 0.61 
Synonyms 16 0.66 
s of genus. . 0.61 
lifference, product 20 0.83 
Total Time 300 


TABLE III. EINTERCORRELATIONS OF VARIOUS FORMS OF GROUP 
TESTS FOR ADULT INTELLIGENCE LEVELS 
33 COLLEGE STUDENTS 


| 


| | 
r | Thing Thing | Species 
| Name | Name | _ of Made |Synonyms of 
| Part | Opposite | Which Is of | Genus 
Part | 
Information 0.03 0.56 | 0.53 0.54 0.48 0.52 
Name part 0.25 | 0.27 | 0.30 0.30 0.33 
Name opposite 0.61 | 046 0.83 0.49 
ng of which part| | 0.49 0.64 0.39 
Thing made of. | 0.49 | 0.55 
Synonyms. . | | 0.21 
| 
J 


| 


Facts like those shown in Tables II and III are being collected 
from individuals of the intelligence level of college students as 
fast as time and facilities permit, so that no test need ever be 
used in the examination until its value has been demonstrated. 
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A NEW METHOD OF RATING TEACHERS 


WILurAM L. Connor! 


Superintendent of Schools, Republic, Michigan 


It is the teacher’s task to make changes for the better ir 
abilities, habits, and attitudes of boys and girls. Her effici 
can be evaluated fairly only in terms of her success at this ¢ 
In other words, if a teacher is rated at all, she should be rated 
by the clothes she wears, or the method she chooses, but by 
results she secures. 

The rating card here proposed, together with the list 
“concrete acts”’ and suggestions for use, constitutes a schen 
rating teachers according to the results they secure with 
and girls. It is not a perfect plan; but it has proved more s 
factory to teachers than the usual type of rating scheme in whi 
personal qualities, training, discipline, attention to equipment 
etc., take equal rank with the results secured. The studies re- 
ported in this paper were made by persons in both supervis 
and teaching positions, who were trying to make a “promotion by 
merit’’ scheme work. Thev believe they have evolved a way 
rating the efficiency of teaching which is better than any schem: 
in common use, but realize it is still vastly short of the “drea 
the scientist in education’’ of which Coffman speaks: a scal 
measuring the efficiency of teaching. 

The stimulus to the evolution of the new rating scheme was 
the adoption by the board of education of Republic, in the fall 
1916, of a resolution creating a uniform basal salary of $550.00 a 
year for the grades and $750.00 for the high school, and also 
empowering the superintendent to rate the efficiency of each 
teacher as a basis for determining additional compensation rang- 
ing from $25.00 to $75.00 a year. These figures were later 
increased to $650.00 and $850.00 per year and the range of the 
bonuses from $50.00 to $150.00. 


hy 


'The author appreciates and desires to acknowledge the assistance given 
teachers, and others including the editors, of the JourNAL oF Epvucations 
SEARCH in the preparation of this study. 

*Coffman, L. D. “The rating of teachers in service,” School Review Monog 
No. 5, p. 14 ff., 1914. 
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Only a short time before, the scheme of paying labor according 
to the product had been adopted in the mines about Republic. 
rhe “bonus for merit”’ plan was thus readily comprehended by 

board of education and adopted as a means of meeting the 
teacher situation. The details of the plan for distributing the 
additional compensation for merit were left to the superintendent 
to devise. As at first proposed and adopted, it was in general 
as follows: Teachers were to be rated by the superintendent and 
divided into five classes, namely, inferior, below average, average, 
above average, and superior. Teachers in the two lowest classes 
were not to receive any extra compensation, the others $25.00, 
$50.00, and $75.00 in order of merit. Later these bonuses were 
increased to $50.00, $100.00, and $150.00 a year 

The first simple rating scheme was composed of material from 
the studies of Ruediger and Strayer,’ Elliott,‘ Boyce,’ and others, 
and was used for the first time in January, 1917. Cubberley had 
only recently written that some such plan was the most important 
means of stimulating and rewarding professional growth and 
efficiency. At the same time, he had warned that it was the 
hardest plan to put into successful operation. Other school men 
whose opinions the writer valued asked him, some jocosely, some 
seriously, if he expected to weather the storm raised by the first 
ratings. It was, then, with mingled hopes and misgivings that 
the plan was presented to teachers for their consideration and 
criticism. 

During the period when the details of the plan were being 
worked out, the teachers were being invited to examine the plan 
and were generally brought to approve its logic. At the same 
time they were warned that the rating scheme proposed for use 
was very imperfect and that the superintendent might make mis- 
takes however just he might try to be. The immediate increase 
of $50.00 a year to over half the teachers, together with the pro- 
spective increases for merit, tended to stay criticism for a while. 
This time was used in getting the teachers ready to attack the 


+h 
iit 


* Ruediger, W. C.,and Strayer, G. D. “The qualities of merit in teachers,” Journal 
of Educational Psychology, 1:272-78, May, 1910. 

* Elliott, E. C. “How shall the merit of teachers be tested and recorded,” Educa- 
tional Administration and Supervision, 1:291-99, May, 1915. 

* Boyce, A. C. “Methods for measuring teachers’ efficiency,” Fourteenth Yearbook 
of the National Society for the Study of Education, 1915, Part II, p. 10. 
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rating scheme, instead of the superintendent or the logi: 
plan, when in due time they should become critical. Litt 
little they were brought to feel that they were about to coop: 
in doing two of the hardest and most worthwhile things in « 

tion; namely, working out a satisfactory scheme for ra 
quality of teaching, and using the scheme in determining 
of the pay of teachers. 


The first formal ratings were passed out in January, 19! 
The superintendent found no superior teachers and only) 
inferior teacher. About one-fourth of the force was rated ; 
average, one-half average, and one-fourth below averag 
inferior together. Bonuses were paid for the first half « 
year. Three-fourths of the teachers received checks for $12.5 
or $25.00 with their first ratings. The expected criticisms 
peared at once, but the lines for it to follow had been well en 
drawn to confine it largely to really helpful suggestions for revisi 
the rating scheme. 


After the first general rating, the teachers became intelligent): 
critical and cooperated actively in revising the method of rati 
used. Various schemes were tried which need not be descri 
here. One involved an attempt to make standard definitions 
merit. 


A small group of superintendents and an equal number each 
of principals, supervisors, and very capable teachers were asked 
to choose, from among the teachers of their acquaintance, 
representative of each of the five classes proposed here, name!) 
inferior, below average, average, above average, superior; and 
then, to describe at work the teachers thus chosen to represent 
the several classes, or merit-groups, using the ‘First Rating 
Scheme Devised on a Cooperative Basis, 1917” as an outline for 
the description (Figure 1). Quite naturally the scheme fel 
through. We could not persuade our friends literally to write a 
book for us in their spare time. Gradually, the conviction grew 
in the minds of the teachers and the superintendent that th: 
scheme gave too much credit to items only remotely related to 
the real business of the school, namely, making changes for the 
better in the behavior of boys and girls. Here I use behavior in 
the sense of all significant mental and physical responses to all 
situations. 


| 
| 
| 
i 


I] 


) While in this state of mind, the author listened to an address 
| given before the Atlantic City meeting of the National Associa- 
Directors of Educational Research in which Assistant 
Superintendent Allison of Chicago stated, by way of illustrating 
a point about the Boyce score card, that it was his belief that the 


tion of 
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RE 1. FIRST RATING SCHEME DEVISED ON A COOPERATIVE 


BASIS, 1917 


Grade or subject 


Address Date 
The Teac her and Her Work 


he teacher 


\. Personal appearance 5 
B. Character 5 
C. Education 5 
D. Social efficiency , 5 
The government of the school....... 
\. Assignments 5 
B. Morale in the despatch of assignments 5 
C. Freedom to initiate social activities 5 
D. Elimination of anti-social conduct 5 


Instruction as providing for educative activities 
\. Thinking.. 


B. Emotional reaction 5 
C. Acquisition of knowledge and skill 5 
*D. Deportment 5 
Che teacher’s attention to 
\. Health and comfort of pupils 5 
B. Play and social life of pupils 5 
C. Grounds, buildings, equipment & sup- 
5 
*D. Professional ethics. . , 5 


Note: Qualities are designated thus:—superior, 1; 


ige, 3; below average, 4; inferior, 5. 
ese two items were added during 1917-1918 


4 
4 


www w 


www w 


www wi: 


ww 


19 
543 
21 
21 
21 
2 1 
5 43 
21 
2 1 
2 1 
5 43 
2 1 
21 
2 1 
21 
5 4 3 
21 
21 
2 1 
21 


above average, 


Another man at the same meeting 


| correlation between personal appearance and teaching ability 
4 was zero or actually negative.® 
wittily remarked: “The homely girls make the principles work, 


while the pretty ones work the principals—p-l-e-s and p-a-l-s, 
ise note.’’ Only recently Morton’s’ study reveals much the 


) 


ont 


B lletin No. 1 of the Board of Education of Chic ago, November 23, 1917, con- 


much of the material used by Mr. Allison in this address 


Morton, R. L., “Qualities of merit in secondary teachers,” 
n and Supervision, 5:225-38, May-June, 1919. 
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same general state of affairs. He says in one place: “Evident 
then, in the judgment of the inspector, a desirable reaction on the 
part of the pupils cannot (certainly) be secured by a teacher w] 
personality and scholarship are ideal, whose methods are ; 
reproach, and who teaches in a room where the physical factors 
are as they should be.” In the judgment of the writer, a per 
fectly groomed teacher of perfect physical proportions working 
with perfectly graded children in a perfect physical environment 
may and often does, use perfectly good methods in a perf 
futile way. 


This rather sweeping conclusion was pretty generally reached 
by teachers in Republic in March, 1918, and it was very s 
afterward that they adopted certain guiding principles for their 
further study of rating teachers. These principles, briefly stated 
are as follows: 

Teaching, not teachers, should be rated. 

. Teaching is measurable in terms of the results only. 
Results may be classified as inferior, below average, average, 
above average, or superior, only with reference to the amount 
of improvement made and the ability of the particular group « 
boys and girls to improve. 

Once these principles are accepted, four general problems 
present themselves for solution. They are as follows: 

1. Determination of a few general headings under which all 
the items of behavior the school desires to affect favorably through 
the agency of the classroom teacher can be grouped. 

2. Evaluation of these headings, or groups of items of behavior 
in the desired result. 

3. Choice, from existing scales, of those which measure prog- 
ress along the lines desired, and the creation of new scales needed, 
or other means of making rough estimates of progress along lines 
where scales are yet far off. 

4. Determination of how much progress any particular group 
assigned to any classroom teacher ought to make. 

The scheme for rendering standards fairly intelligible, which 
was finally decided upon as the only feasible one for Republic 
was this: 

1. All items on the rating card were defined in general terms, 
with reference to the dictionary. 


wre — 


No. 
ri 
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ently 2? Items were redefined in terms of the standards thought 


desirable in education. 
3 As' many concrete acts and conditions of teachers, teaching, 
ipils, s¢ hoolrooms, etc., as could be collected by the superin- 
rs rendent and the cooperating teachers were typewritten and made 


per ‘lable for use in supervision. This material grew rapidly 


ing m a few pages to more than a hundred. 


[he seven elements or standards by which teachers were to 

ted were mimeographed on separate slips of paper and dis- 
d, with appropriate explanations and directions to those 
r part in the experiment. 


STANDARDS 

I. THINKING 
neral definition: Mental activity in the course of which the mind 
ficulty, and in the process of solving the difficulty arrives at a 
which is, to it, a new meaning, belief, act or way of thinking, or 
nation of these. Definition of standard: Thinking by pupils in 
recitation, and test of the quality and amount agreed upon and 

n the course of study or other practice standards. 
Il. EMOTIONAL REACTION 

neral definition: Feelings, and actions growing out of feelings. Defint- 
n of standard: Appreciation resulting in immediate pleasure, and emotion 


‘ms iding to action which is of individual and social value. 


KNOWLEDGE AND SKILL 
General definition: Information and practical efficiency in doing. Defini- 
‘andard: Classroom practices and results as to knowledge and skill 
s set down in the course of study and other practice standards. (A course of 
n which standards of procedure and results as to knowledge and skill 

iired are not determined by objective measurement of both needs and 

results, in so far as that is possible today, is hardly to be defended.) 
IV. Morate in DespATcH OF WorK 

General definition: Confidence, courage, loyalty, self-reliance, prompt- 
ness, and persistence with which work is performed. Definition of standard: 
Confident, courageous, loyal, self-reliant, prompt, and persistent spirit of 
pupils at work. 

V. INITIATIVE IN SOCIALLY SIGNIFICANT SITUATIONS 

General definition: Ability and will to propose or choose, lay out, and 
carry forward work furthering the purpose of the individual and the group. 
Definition of standard: Pupils proposing or choosing, organizing, and carrying 
torward work furthering the educative purpose of school groups. 

VI. Ersicat IN SITUATIONS SOCIALLY SIGNIFICANT 

General definition: Inhibition of actions which would interfere with 
carrying forward the purposes of social groups. Definition of standard: 
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Inhibition in the classroom, and other group-units of the school, of 
interfering with carrying forward educative activity. 
VII. DepoRTMENT 
General definition: The manner, bearing, or style of a persor 
things. Definition of standard: Easy, natural, graceful, and court: 
correct form in doing things. 


INSTRUCTIONS ACCOMPANYING THE STANDARDS 
THINKING STRAIGHT 
All of you who arrange these standards want to express your | 
ment of the relative values of the standards. In order to do t! 
thinking of the time order in which you may have been taught to bel 
standards are acquired by boys and girls. Think rather of the 


acts making up each standard as being considerably different at 


ages. More concretely, think of the group of boys and girls you t 
possessed, and not possessed alternately, of the attitudes, abilit 
habits implied in each standard, and ask yourself: “In what order 
tance would I place the possession of these standards by my boys an 
How would I emphasize their acquisition by the pupils under my cl! 
felt a deep responsibility to each individual in my group, and to so 
whole, and knew my efforts this year were to be the last conscious ed 
efforts to be expended on a majority of these boys and girls for th 
their lives?”” But do not rate any proposed standard low because you 
now know how to get pupils to acquire it. Rate the standard ; 
to its importance or desirability, and face squarely the issue of finding 1 
subject-matter or methods by which the standard may be realized. I 
concrete fashion, test and re-test your arrangement of the standards. 
FINAL DIRECTIONS FOR ARRANGING THE STANDARDS 

1. Read the seven standards critically, trying to evaluate them. 

2. Spread the standards out before you so that you can get what t 
contain in perspec tive. 

3. Arrange the slips on which standards are printed in the order of t! 
importance of the standards in the results of teaching, beginning with t 
most important. 

4. If, in your judgment, the least important standard is so low 
approach zero, mark it zero. 

5. Pin slips together in the order in which you rank the standards 
return them in that order. 


in school work, assisted in the study by arranging these standards 


One hundred and thirty-two persons, all of whom were engaged 


Fifty of the judges worked under the personal direction of the 


author, and 45 others under the direction of one or another 

the first fifty. The remainder of the judges received the material 
by mail. Seven of the replies were rejected because it was ap- 
parent that the persons making them had not followed directions 
The returns from 125 judges were tabulated. 


4 
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A few less than a hundred judges may be grouped into four 

isions as follows: A group of graduate students in a certain 

iniversity, a group of local teachers, a group of teachers and 

: teachers-in-training in a city normal school, and a group made up 

nentary and junior high-school teachers working under one 

cipal in a large city. The remainder of the judgments were 

le by principals and superintendents in various Michigan 
towns and cities. 

The data derived from the 125 judgments are as follows: 


TABLE I. FREQUENCY WITH WHICH EACH RANK 
WAS GIVEN EACH ITEM 


Item Rank? 
, | o |] 1 2 3 | 4 5 6 | 7 
I | if 7 | 28 | 79 
11] | 9 | 9 | 13 | 23 | 23 | 35 | 13 
' 3 | 12 | 23 | 19 | 31 | 23 | 14 
I | | 6 | 10 | 27 | 2 | 28 | 16 | 9 
, I | 12 | 23 | 20 | 28 | 24 | 12 6 
V1 |} 18 | 43 | 32 | 12 | 4 | 12 4 
VII 1 | 76 | 29 3 | 7 | 
| | | | 


The h the rank, the larger the nt indicating “Iter ms of such 
ll value as to be insignificant, in the opinion of the judges, are scored 0. 


* The number of items in the original material are preserved for reference. 


Table I should be read as follows: Seventy-nine judges thought 

Item No. I most important, 28 thought it second in importance, 

seven thought it third in importance, and eleven thought it fourth 

inimportance. None thought it less than fourth in importance. 

The returns for the different groups have also been tabulated 

separately. From these tabulations the following facts appear: 

d 1. The order of importance of the items is the same in the 

case of each of the groups of judges. 

The general form of each distribution for each item is the 
same for each of the groups of judges. 

3. The judges who worked under the personal direction of the 
author recognized the real differences in relative position as 
established by the whole group a little more frequently than did 
the judges to whom the material was sent by mail. 


en 
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It is probably safe to conclude, therefore, that the items d 
reality stand in the order of importance here assigned. On 
other hand, the importance of this order may be great or s; 
according as the absolute value assigned to the least import 
item in the list is great or small. 

From Table I, the values of the various items in terms of prob 
able error units have been determined and corrected into poin: 
scales of 100 and 1,000 points. 


TABLE II. THE VALUES OF THE ITEMS 


Percent Fac h 
Value of | Cumulative or Value Is of 7 
Intervals | Total Values Total Value Basis of Ba 


0-VII 3.0 Vu 3.0 7.37 7 75 


VIE-VI 16 | VI 46 11.30 | 11 115 
VI-I 1.0 | I 5.6 | 13.76 13 135 
I-IV 03 | IV 5.9 | 14.50 14 145 
IV-V 04 | V 6.3 | 15.48 | 16 155 
V-I 02 | I 6.5 15.97 17 160 


23 | I $8 | 21.62 | 22 215 


Totals 8&8 | 40.7 | 100.00 100 1.000 


The value of the various items varies according to the valu 
assigned the least important item in the list. For exampl 
Item No. VII were zero, as one judge would have it, Item No. | 
would be 5.8 units, or three and six-tenths times the valu 
Item No. VI, under the same condition. Whereas, under 
value assigned to Item No. VII, Item No. I is only one and nit 
tenths times the value of Item No. VI. On the other hand, ii 
Item No. VII were assigned a value of 5.0 units, Item No. I wou 
be only about two times the value of Item No. VII; whereas 
under the value now assigned to Item No. VII, Item No. I is 
three times as important as Item No. VII. Without going any 
further into the need for, and difficulties involved in, trying t 
fix a value for one of the items with reference to zero, it may be 
said that three units were adopted as the value of the least impor- 
tant item, mainly, because the author was in constant contact 
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with a number of judges who were willing, for the most part, to 
wa value that high for the item in question, but were unwilling 
,t the value should be placed any higher. The reason, then, 
for assigning a value of three units to Item No. VII, deportment, 
1s a practical one rather than a scientific one. 
The rating scheme which follows is based upon the values 
nin Table II. 
2. TENTATIVE PLAN FOR RATING A TEACHER ON THE 
PROGRESS SHOWN BY PUPILS 


give 


— 


€ — 


Date 


gh estimate of GENERAL Merit: A B C D E (Circle thus: @ 
s of results or progress by observation, examination, or application of 


1 tests or scales, or by two or more of these methods 


RAL MERIT 


I. Deportment. ‘ | 1 2 345 6 7 
II. Ethical self-control 11] 23 | 45678 910 | 11 
III. Emotional reaction 11/234 56789 10-1112 | 13 
IV. Morale 1};234 5678910 11 12 13 14 
V. Initiative /1/2345 67891011 12 13 14.15] 16 
VI. Knowledge and skill. 1/2345) 67891011 12 13 1415 16} 17 
VIL. Thinking 1 2/3 45 617 89 10 11 12 13 14 15 16/17 18 19 20)21 22 
Summary: Numerical score__...._- Equivalent: A B C D E (Circle thus ©) 


Explanation: Numbers for each item in the groups A, B, C, D, and E give the 


wing approximately correct numerical values for each group: A (superior) 93-100; 


B (above average) 72-92; C (average) 30-71; D (below average) 9-29; E (inferior) 0-8. 


SUGGESTIONS FOR IMPROVEMENT: 


Criticisms interpreting the rating given usually cover several type- 
written pages, and contain references to the list of “concrete acts’’ appearing 
below, results of standard tests given to pupils, and the principles of educa- 

s expressed in standard books on education and psychology. A brief 
summary of this material appears here. Copies are kept for reference and 


mparison.) 


Superintendent 


i 
Wav, 1920 
Al {I 
rtans 
K 
An 
j 
Gene . . D | ( B A 
| 
| 


348 JOURNAL EDUCATIONAL RESEARCH J 


While still working with the typical mixed rating sche: 
pared as the result of the first cooperative patchwork on 
plans, considerable progress was made in collecting « 
examples of each standard proposed. Enough was done t 
it clear that the bulk of such material, if collected, woy 
enormous. While work was progressing on the evaluation 
seven general headings, some attempt was made to choos: 
ble material from the earlier study and restate it a. a list 
crete acts, which, if observed in pupils, would be some evi 
that the standards under which they were classified wer 
acquired. To this material were added statements con 
the standard tests and scales in use or proposed for use in R¢ 
schools. Lastly, teachers contributed an enormous an 
material so detailed that it was thought necessary for 
purposes to have a committee classify, arrange, and cor 
it into the limits of seven mimeographed pages. 

The list of concrete acts which follows represents a cond 
statement of the supporting material used with the pr 


scheme for rating teachers on the basis of the results of 


teaching. Any teacher, pupil, or supervisory officer, atte 
to use this material will of necessity choose only thos 


applicable to the case in hand. Many teachers have pre; 


for themselves much more complete and detailed examples 


each standard, but they fall under some of the headings giver 


CONCRETE ACTS 
STANDARD I. THINKING 
1. Attains standard score for his grade in 
a. Stone’s Reasoning Tests (grades 3-8) 
b. Composition (grades 4-12) 
c. Trabue Language Scale (grades 2—12) 
d. Thorndike’s Visual Vocabulary Scales (grades 3-12) 


e. Thorndike’s Scale Alpha 2 for Measuring the Understanding 


Sentences (grades 3-12) 
f. Starch’s Physics Test 
g. Henmon’s Latin Tests, etc. 
2. Attains normal school grades in 
a. School tests over minimum essentials in arithmetic 
b. Teacher’s or superintendent’s test in other subjects 
c. School tests in grammar (grades 5-8). 
3. Expresses himself clearly in his own words. 


4. Exhibits ready ability in reproducing in recitations the thinking tha 


been done before in mastering past work. 


ol 
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rprets intelligent!y any complex directions for work. 


fies and arranges material well. 
es accurately, though sometimes awkwardly. (In the kindergarten 


tes and defines difficulties in material suitable for his grade. 
ses solutions to problems cautiously and tries them, selecting 
| rejecting material intelligently 


ches tentative conclusions and holds them tentatively while searching 


more evidence. 


fies conclusions carefully before considering them final. 


lers the bearings of conclusions carefully. 
ts the true bearings of conclusions when they are pointed out 


luates problems as well as the material used in the solution of prob 


ms. 


les correctly when to depend on his own resources and when to seek 


help. 


STANDARD II. KNOWLEDGE AND SKILL 
ns standard scores for his grade in 
Courtis Standard Research Tests, Series B, in fundamentals of 
arithmetic (grades 4-8) 
Woody’s Arithmetic Scales (grades 2-8) 
School tests in minimum essentials in arithmetic (grades 3-8) 
School tests in minimum essentials in grammar (grades 5-8) 
Spelling words from Ayres Spelling Scale concealed in sentences 
Composition, technic (grades 2-12) 
Copying familiar material (rate and quality) Ayres Handwriting 
Scale “‘Gettysburg Edition” 
Stone’s Reasoning Tests (grades 3-8) 
rrabue’s Language Scale (grades 2-12) 
Starch’s Physics Test 
Thorndike’s Visual Vocabulary Scale (grades 3-12) 
Chorndike’s Scale Alpha 2 for Measuring the Understanding ot 
Sentences (grades 3-12) 
Henmon’s Latin Tests 
Rugg and Clark’s Standardized Tests in First-Year Algebra 


2. Attains normal grades on teacher’s and superintendent’s tests in subjects 
not covered by standard tests. 


hibits daily in the recitation a ready knowledge of facts and skill in 


ndamental processes of the subject in hand. 


iu 
Note: Whatever value is assigned to items 2 and 3 should be appor- 


tioned about equally among the subjects for which the teacher is 
responsible, and for which satisfactory standard tests have not yet 
been devised. 


STANDARD III. INITIATIVE IN SOCIALLY SIGNIFICANT SITUATIONS 
\sks questions worth while for the whole group to answer. 
2. Proposes problems essential to the progress of the group in the subject at 


hand. 
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Examines material in advance so as to be of service to the teacher a 
class in laying out the work for the following day or week; i. 
actively in making the assignment. 

Volunteers information, and makes helpful suggestions in the 

he recitation. 

Seizes upon class problems for further reading or experiment. 

Prepares to contribute intelligently, and offers promptly and e 
keep the topic, question, or problem going during the recitat 
Note: Many recitations make one think that teaching, like n 
dentistry), is an extractive industry. 

Calls attention to current literature, discoveries, inventions, or 
affairs as related to topics or questions on hand 

Proposes for group decision the game to be played during the pla 
language periods. 

Proposes changes in games and discusses the changes with teacher a 
pupils. 

Is not idle when assigned work is finished, but finds useful work t: 

his weak points and practices to overcome them. 

Does many useful things without being told. 

Asks for needed information or suggestions when his own resources {ail 


Discovers 


STANDARD IV. MorALE 

Attends school regularly, and arrives promptly at the opening of 
session. 

Is cheerful, and agreeable when he cannot have his own way. 

Moves to and from classes and about halls in a prompt and orderly 
manner. 

Is loyal to teachers and the work they assign. 

Is loyal to school officers and the rules they make and enforce. 

Is loyal to the school and its undertakings. 

Obeys all ordinary requests promptly and cheerfully, and in spirit as wel 
as letter. 

Does not talk back or sulk when corrected. 

Does not fret or worry over school tasks, but seeks to understand t! 
and does his best cheerfully. 

Does not cry, whine, or tattle over little things. 

Is not discouraged by defeat or failure. 

Does hard or otherwise disagreeable work without expectation of pr 

Works in the confidence that he and his classmates can do what 
boys and girls have done and are doing, and a little more. 


Relies upon his own efforts in preparing a lesson. 

Undertakes with courage work he knows to be difficult. 

Finishes assigned lessons even if he is compelled to spend more time ¢ 
them than some of his brighter classmates. 

Begins work promptly and plunges into the heart of it. 

Faces duties and responsibilities squarely—does not “‘sidestep”’ or “pass 


the buck 
Does not hunt for and elect supposed “snap courses.” 


4. 

5 

6 

7. 

8 

9. 

10 
11 

12. 
13 
3 
4 

5 

6 

7 

8 

9. 

10 

11 

12. 

13 

14. | 
15 
16. | 
17 | 
18. 
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Is conscious of some of the important habits which go to make up a 
worthy character, and strives to act so that these habits will be formed. 
STANDARD V. EMOTIONAL REACTION 
Appreciates standards of achievement in school subjects and wants to 
attain them. 
\ppreciates standards of achievement in school subjects and wants 


pret 


} 


nis 


class and his school to attain them. 


lakes pride, but not foolish pride, in his class, school, city, state, or nation 
lakes pride in superior workmanship, and will not do slipshod work. 


; pride in the character of his associates and chooses them so that 
he will not be ashamed of them. 

lakes pride in cleanliness of person, schoolroom, premises, and streets 

Wants to serve his class, school, town, state, and nation. 

Enjovs good music, literature, and art. 
kes innocent fun on every proper occasion. 

Enjoys school exercises:—rhythm, story-games, free games, etc. 

Gets a true emotional reaction out of insight into external truth either 

science or in religion and morals. 
Feels and expresses reverence for ties of friendship, family, and religion 
Does any desirable act because he wants to be helpful, and refrains from 
idesirable acts because he dislikes them 

\ppreciates kindly motives in others and gets satisfaction out of express 
ing his appreciation. 

Values the personality of others and his own as well. 

In the classroom acts of service are popular. 

STANDARD VI. Ernicat SELF-CONTROL IN SITUATIONS SOCIALLY 

SIGNIFICANT 

Obeys requests promptly and cheerfully. 

Obeys the rules of the school. 

Enters the room and leaves the room quietly and inconspicuously, 
especially during school hours. 

Avoids coughing or spitting in public. 

Does not intrude on another person’s privacy or take his time unjustly. 

Does not “delay the game.”’ 

Tells the truth without evasion. 

Borrows little and returns borrowed articles promptly and in good 
condition. 

Does not steal or even borrow without permission. 

Keeps appointments. 

Keeps promises made, and avoids rash promises. 

Does not copy work or seek unfair help from others. 

Will not permit copying or give unfair help to others 

Does not “bluff” in ihe recitation. 

Does not bribe, trade, blackmail (threaten to tell) or use any other undue 
influence to have his own way in athletics or other school affairs. 

Controls temper and avoids quarrels. 

Does not allow himself to be bribed, intimidated, or influenced unduly in 
any way in school affairs. 
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Does not tattle, but will not allow the interests of the school t: 


} 


injustice to be done because of lack of information he could su 


19. Does not tease or bully weaker persons nor allow others to do so 
protest. 

20. Cooperates in protecting school buildings, premises, and street 
litter such as fruit skins, paper, and marking. 


STANDARD VII. DEPORTMENT 
1. Sits well back in seat leaning forward from his hips, feet on fi 
erect, and forearms resting easily on desk when writing or w 


lesk 
ym. seat, stands erect on both feet, free irom 


2. Rises easily fr 


reciting nad cite il 
iting and Sits again easy. 
3. Walks or runs lightly in moving about classrooms and halls. 
4. Speaks and reads clearly and distinctly so that every person in ther 


may hear 
5. Holds book or paper in correct position when reading orally 
6. Passes and collects materials quietly and easily. 
7. Takes out and puts away work quickly, quietly, and neatly. 
8. Puts on and takes off wraps quickly and quietly. 
9. Does not stop work to stare at visitors. 
10. Is courteous: 

a. Is unassuming. 

b. Avoids abrupt speech and coarse manners. 

c. Laughs and talks quietly. 

d. Does not rush or crowd in halls. 

e. Allows others to enter doors ahead of him. 

I. Keeps to the right. 

g. Avoids passing bet ween persons in conversation or in front of any: 


h. Grants a favor or acknowledges one easily. x 

11. Does not put pencils or pen in the mouth, or fingers in mouth or nos« S 
12. Dresses neatly and is clean. t 
13. Keeps working materials in order on desk, and at the board 
14. Turns in neat work. f 
15. Responds, when addressed, pleasantly and in good form, answering ‘ 
information in clear sentences. . 

A careful reading of the above list of concrete acts will reveal 
that the means at hand for making scientific observations of the 
progress of pupils are scanty. It is still necessary, if one wishes ‘ 
to know whether pupils are making progress in forming most oi , 
the desirable habits and attitudes which they ought to form as 
the result of their school experience, to watch them at work and 
play in all the situations for which the school is responsible. Con- , 


sequently, it would be foolish to assert that the most careful 
observer can detect more than the general trend of habit and 
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ttitude formation outside of the limited field now occupied by 
iles and tests. This is one of the strong points made by 
ers against the author’s use of the rating scheme in rating 
ir work. 
It does not seem at all impossible, however, that, should we 
elop means of measuring progress in habit and attitude forma- 
along the lines indicated in the concrete acts proposed above, 
ga we would soon develop a technic of producing the desired results 
boys and girls with a great deal more certainty, ease, and 
pidity than we now have reason to believe we shall develop it 
the next fifty years. At least the lists above furnish the basis 
r further experimental work. 
The facts in regard to the actual ratings given teachers from 
1916 to 1919 are shown in Tables III, IV, and V. 
If the marks given below represent the facts, the first semester 
the rating scheme was in use the median teacher in Republic was 
ow-average teacher. The second semester, an average teacher; 
the third semester, an average teacher; the fourth semester, a 
| the sixth semester, an above-average teacher. Reference to 
rating scheme above would indicate that the gain was from a 
median teacher of ability 35 to a median teacher of ability 80. 
In other words, in the judgment of the superintendent, the 
efficiency of the average teacher in Republic schools as a result- 
getter more than doubled in the three years under discussion, and 
this in spite of the fact that the above-average teachers were 
being drawn off by schools which paid better salaries at least as 
fast as the superintendent was able to improve or eliminate the 


as teacher of below-average ability. The explanation can be found 
” only in the fact that, with better salaries, and clearer notions of 
™ what good teaching really meant, the superintendent was enabled 
“% to recruit from other cities and from normal schools and colleges 
a a higher grade of teacher material than ever before. For example, 
of 20 percent of the teachers now employed in Republic achieved 
i honors for scholarship in normal school or college. Some others 
* were recommended as the best students in special departments. 


However, this does not discredit the value of the rating scheme 
A as a supervisory device for the superintendent proved able to 
develop teachers while in service. Thirty-seven percent of the 
teachers who have been employed for a semester or more in 
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TABLE III. RATING OF INDIVIDUAL TEACHERS— 
SIX SEMESTERS, 1916-1919 

REPUBLIC TOWNSHIP SCHOOLS, REPUBLIC, MICHIGAN 

017-18 1918-19 

1917-1 ! R 


Teacher ist 2nd ist 21 Ist 2nd Wit) 
Semester Semester Semester Semester Semester Semester : 


D D D 


Marriage 


Marriage 


Promotion 


Promotion 


Death in famil 


Promotion 


Promotion 


| 
| 
| 


38 B B | Death 


A blank in the column “reason for withdrawal” means that the t 


is still in service in Republic schools. 
“Promotion” means taken by some other city at a higher salary 
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1 Cc B 
2 Cc | is Cc Re juest of supt 
3 A A 
4 te Promotion 
5 DpDinbicic B B 
6 -¢ > C | Request of supt 
7 £ Request of supt 
8 | BI] B | Poor health 
| E D B | Request of supt 
11 D Request of supt 
12 | D Dissatisfact 
13 D D Di tisfact 
14 | B B B B B B | Retirement 
15 | E 
16 | Bi B B | B \ A | 
17 | 
20 ] 
21 i 
22 c |p | E Request of supt 
23 B Promotion 
24 c | Promotion 
2 | B | B B | B 
26 E D | B B 
28 B B | B Poor health 
29 B 
30 | C B | B B | 
31 | | Cc | 
33 | D B | b | 
| | B | 
35 Di 
36 | 
= | | | Bi BI 
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TABLE IV. DISTRIBUTION OF MARKS GIVEN TO TEACHERS, 
BY SEMESTERS, 1916-1919 
REPUBLIC TOWNSHIP SCHOOLS, REPUBLIC, MICHIGAN 


1916-17 1917-18 1918-19 
Mark ist | 2nd Ist 2nd ist 2nd =| Total 
Semester | Semester | Semester | Semester | Semester | Semester 
— 
\ 2 2 
B 4 6 6 | 10 11 14 51 
( 11 | 10 10 | 7 7 | 3 48 
D 4 | 3 | 3 1 | 1 17 
4 2 1 5 
21 21 21 21 21 20 125 


TABLE V. DISTRIBUTION OF LAST MARKS GIVEN TO TEACHERS 
WITHDRAWING FROM REPUBLIC SCHOOLS 


REASON FOR WITHDRAWAI 


Required Promotion Other Reasons 
\ | | 
B | 1 5 3 9 
Cc 3 4 2 9 
D 2 | | 2 
| 2 | 1 5 
6 23 


Republic schools during the last three years have shown enough 
improvement to cross the boundary between a lower and a higher 
rank. Fifty-three percent of the teachers now in Republic schools 
have improved at least one division. In other words, supervision, 
as it found expression in suggestions for improvement in the items 
of the rating scheme, was about equally responsible with elimina- 
tion of the less capable and the employment in their places of the 
more capable type of teacher, for whatever improvement has 
taken place in the efficiency of the teaching corps. 

Of course, the question of the accuracy of the ratings of the 
teachers is an important one. The study has the limits imposed 
by the fact that one judge, and only one, rated the work of one 
group of teachers, and only one. On the other hand, the methods 
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used in rating were, it is believed, vastly more objectiv: 
hence, more reliable, than those presented in any other r 
study yet made. To the mind of the author the greatest evi 
against the validity of the absolute rating is the fact that 
median teacher is rated above average, and that the distributi 
teachers is around that point instead of around a teacher 1 
average. Every other bit of evidence points to the fact t 
very marked improvement has taken place in the teaching 
in Republic schools. Hence, if serious error has been ma 
was made when the teachers of Republic were rated for th 
time in January, 1917. 

The absolute authority placed in the hands of the superint 
ent to eliminate teachers had so much to do with whatever 
cess attended the use of the payment-for-merit plan, that it w 
be foolish to recommend the plan for general adoption wher 
authority mentioned does not exist. The reasons for 
teachers could be dismissed were as follows: 

1. Low efficiency, without, in the judgment of the superintend 
ent, prospect of improvement in the immediate future 


repeated after warning by the superintendent. 
Republic, like every other community in the land, has its school 
politicians. These men and women study constantly every 
feature of school administration, supervision, and teaching 
for the sake of providing better school facilities for boys and girls 
but for the sake of gaining personal advantage from any phas: 
school work which can be put in the wrong light before the publi 
These persons do not have to be reasonable or consistent in ord 
to be troublesome. Soon after the bonuses were made larg 
enough to attract their attention, they began to demand that th: 
amount of the additional compensation should be saved to t! 
public. They contended that a teacher would teach a year | 
the basal salary just as willingly and just as efficiently as she w 
for the basal salary plus the bonus. They contended further that 
the teacher who was not that sort of an idealist was not fit 
teach boys and girls anyhow. Even if the scheme could have been 
defended successfully from attacks from without, it would still 
have been in the way when it came to employing new teachers, 


for the teachers desired could hardly have been employed even tor 
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equal to the basal salary and the median bonus ($100 a year) 
ined. It was clearly impossible to secure funds to care for 
onuses in addition to the necessary basal salaries. Hence, 
.dditional compensation-for-merit scheme was abandoned in 
) and the superintendent and most of the teachers breathed 


ich of relief. 
lhe rating scheme proposed above is still in use as a supervisory 
vice, but, of course, without any relation to the salary schedule. 
| in this way, the rating card is a valuable supervisory instru- 
Additional evidence of this fact was obtained as follows: 
Some time following the fifth semi-annual rating the superin- 
ent was requested to present the results of his inquiry before a 
meeting of superintendents and school board members. Ac- 
rdingly, the following notice was sent to teachers in the largest 
uilding in Republic Township: 


| have been asked to present the results of my investigation leading to a 
tive scheme for rating teachers before the State Association of Super- 
lents and School Board Members. Before accepting the invitation, I 
ld like your candid opinion as to whether your cooperation in forming 
scheme and in being rated by it has affected your work and how. Record 
conclusions on this paper without consultation and without signing 
ol the paper. No effort will be made to hold anyone responsible for adverse 
igments. Indeed, no effort will be made to discover who wrote which 
paper. However, the opinions may be classified as to the amount of profes- 
nal thought they reveal before they are presented to the Republic teachers 
r any other audience. 
Wa. L. Connor 
Superintendent 


Replies were received in sealed envelopes, shuffled thoroughly 
by a clerical assistant, and typed for the consideration of the 
superintendent. They ranged from replies as favorable as the 

following: 


My opinion of the rating scheme is as follows: 

First, it aids the teacher to measure her pupils, and find their weaknesses, 
thereby giving her a chance to help them overcome their trouble, whereby 
he teacher gets the result required. 

Second, it helps the teacher to measure herself and gives her a chance to 
study the standard by which she is measured. 

Third, following the rating scheme as closely as possible helps my pupils 
to think and helps me to help them. 


rhe 
wd 
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To those as unsatisfactory as the following: 


If my cooperation in forming our rating scheme, and being rated by 
has in any way affected my work in the school I am entirely unconscious 


Of the seventeen replies received, twelve were favorable and fiy: 
adverse or noncommittal. The comments, however, make j 
clear that a great deal of good came out of the work of ratin 
teachers. On the other hand, it would be difficult to read thro 
the discussions presented without gaining the impression that 
great deal of misunderstanding and hard feeling existed. Indeed, 
enough soreness is in evidence to have disrupted any administra 
tion not securely founded. However, the dissatisfaction 
directed more against the payment-for-merit plan than against t! 
actual operation of the rating scheme as a supervisory device. 

It is safe to say that at least three-fourths of all teachers 
employed in Republic schools were willing to work under the 
merit plan, and very seldom did the other fourth openly express 
dissatisfaction. How much of this seeming content was due to the 
fact that everybody’s salary was going up anyhow (the scheme was 
accompanied by a general rise in wages in no essentail way related 
to it), how much of it was due to the merits of the rating schem: 
how much to the fact that teachers cooperated in forming the 
plan, and how much to the fact that the superintendent exercised 
rather unusual powers in employing and discharging teachers, it 
would be hard to tell. 

However, if the superintendent of the Republic schools could 
secure a living and saving wage for the least experienced and poor- 
est trained teacher in the corps, together with reasonable increases 
for additional experience and training, up to 75 percent more than 
the minimum wage, he would recommend that the question of 

extra compensation for merit be reopened. 

In the meantime, the rating card proposed above, while imper- 
fect in certain respects, is still in use in supervision, and really 
represents an advance over previous efforts. It is a useful 
supervisory device because it directs attention effectively to im- 
portant elements in the changes which it is a teacher’s task t 
produce in children. 


RI 
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REPRODUCTION AS A MEASURE OF READING ABILITY! 


ARTHUR W. KALLOoM 
poriment of Educational Investigation and Measurement, Boston, Massachusetts 
THE IMPORTANCE OF SILENT READING 

-eading in some form occupies a large share of the curriculum 
both lower and upper grades. In the first grade the time is 

st wholly occupied in teaching children how to read; and, 
| reading predominates. As the child progresses through the 
les the time devoted to oral reading gradually diminishes and 
time devoted to silent reading increases. 
These two forms of reading have entirely different aims. Oral 


some hearer. Correct pronunciation, clear expression, and good 
enunciation are, therefore, necessary in the oral work. These, 
wever, are only the mechanics which enable the reader to con- 
the thought which he has in mind with force and understand- 
In silent reading, on the other hand, the aim is to teach the 
il to obtain the thought from the printed page for himself. 
lhis silent reading is followed by some form of reproduction 
ther at once or at some future time. Until recently the teacher 
the upper elementary grades has not felt the importance of 
aching silent reading. Even now it is very probable that she 
joes not realize the full importance of this teaching. Reading, 
oral or silent, means the recognition of the printed word as a sym- 
| and a correct interpretation of the symbol into a picture for 
which the symbol stands. 
FACTORS IN SILENT READING 
This is not by any means a simple process. It may be analyzed 
into the following factors: 
(1. Correct visualization of each word 
2. Knowledge of the various meanings of each word 
3. Choice of the correct meaning as shown by the context 
' An address delivered before the National Association of Directors of Educational 
Research at Cleveland, Ohio, February, 26, 1920. In the absence of Mr. Kallom 
e address was presented by Miss Harriet M. Barthelmess. 
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4. Forming of the correct relations between these meanings j, 
order to interpret phrases and clauses . 

5. Forming of the correct relations between phrases and clays 
in order to interpret sentences and paragraphs. 

This interpretation of words, phrases, sentences, and paragray 
depends on at least two things: (a) the pupil’s experienc 
(b) his ability to recall the experience and apply it to the case g 
hand. 

Any inability on the part of the pupil to make application of his 
experiences or the making of a wrong application results in error 
Two illustrations will make this thought clear. Question 14 

Kelly’s Kansas Silent Reading Test II reads as follows: 

A list of words is given below. One of them is needed to comp! 
thought in the following sentence: The roads became muddy wi 
snow 
Do not put the missing word in the blank space left in the senter 
put a cross below the word in the list which is next above the word need 
the sentence. 

water 

1S 

melted 

snow 

This question is one of the most difficult in the entire test, 
being given the value of 4.9. To solve this question correctly the 
pupil must: 

1. Refrain from filling in the blank with the correct word 

2. Correctly interpret the phrase “‘below the word in the list” 

3. Correctly interpret the clause “which is next above the word 
needed.”’ 

These three phases must be correctly interpreted not onl) 
individually but also with relation to each other in order to get t 
correct answer. The high value of 4.9 for this question is proba- 
bly due to the fact that pupils do not see the relation between th: 
parts correctly. Pupils do not, as a rule, fail in reading 
words of this selection nor in knowing the meaning of the individ 
ual words, for none of them is difficult, but they do fail in wnder- 
standing the relation between the words, phrases, and clauses/ 
The failure to see this relation is often laid at the door of careless- 
ness. This may be a cause at times, but more often a lack 
experience in meeting such a complicated situation is a contribu- 
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tory cause and at times may be the important cause of the error. 
The pupil has been in the habit of placing a cross before or after 
word, and when he reads “‘put a cross’ his experience leads him 
it a cross before or after the word, thus making an error. 
But pupils also make wrong interpretations of individual words. 
One of the tests given to grade v in May 1919 was the part of the 
story of Aladdin in which the magician directs Aladdin to go to the 
m of the stairs into a great underground building divided 
three vast halls. In each of these halls Aladdin was to find 
ge brass vessels. A boy who had read this selection inter- 
preted the word “vessels’’ to mean ships. He had a perfect 
icture of this underground room as some sort of museum in 
) these ships were placed. After some questioning as to what 
r meaning the word “‘vessels’’ might have, he remembered the 


ning of an “urn” or “‘vase.”” Immediately his whole picture 
; changed. A pupil left to himself, however, does not get a 
nce to have this impression changed. He may, therefore, go 
for some time on the basis of the wrong interpretation. 
The teacher may learn of this wrong interpretation only through 
form_of reproduction. The great criticism against repro- 
iction has been that it involves memory. What is generally 
meant is word memory without thought or without meaning. 
should be decried everywhere and at all times. ' But the 
right kind of reproduction, depending on the right kind of memory 
should be cultivated, for every discussion depends on the ability 
) think correctly. 


BosTon’s PROGRESS 


In 1915 and 1916 Mrs. Ellor Carlisle Ripley, assistant superin- 
endent of schools, was placed in charge of the reading throughout 
the schools of Boston. In undertaking to improve both oral and 
silent reading four plans were used: 

1. Asking principals and teachers to assemble the children in 
the auditorium, having the best readers act as an example to 
others by reading selections before the audience of the other 
ipils 

Asking students in the various schools of elocution to read 
selections suitable for children before the entire school in the 


auditorium 
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3. Selecting two or three of the best readers from a 


different schools, assembling them at a central school, ar 


them read prepared and unprepared selections before an 


of other pupils, parents, and friends 


4. Visiting a large number of rooms to hear the childr 


cially the poorer ones) read in their regular classes. 

In conjunction with the third phase of this work, vi 
selected children had gathered from a number of schoo! 
auditorium, the Department of Educational Investigati 
Measurement used the Kelly Silent Reading Test. One | 
and eighteen of these selected children were tested in all 


came from all grades, a few even as low as the fourth 


principals were encouraged to send upper rather than lo 
children. The results showed that these pupils had a la 


of individual differences. There was a great deal of ove: 


but the medians were from two to eight points higher t] 


standards set by Professor Kelly. 


SELECTION OF MATERIAL FOR SUITABLE TESTING 


As a result of having the Kelly test given to this small 
selected pupils, many of the teachers felt that reading abilit 
not being tested. They, therefore, wished a further t 
made with selections more nearly like the ordinary reading 
pupils. As a result of this, in the fall of 1916 a committe 
teachers representing grades Iv to vill inclusive, met | 
purpose of selecting suitable paragraphs for testing grades 


vI. vu, and vi. The following directions were given for gu 


ing the teachers in making their selections: 
1. That the paragraph selected should be from 100 to 15! 


in length 
2. That the paragraph should as far as possible tell a con 


story . 
3. That the teachers should select paragraphs suitable for th 


own grades 
4. That paragraphs selected should not be familiar 


children. 

As a result of the work of this committee, the depart 
received for each grade four or five selections which the tea 
that grade thought were suitable. The members of the di 
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»t undertook to make from this collection of material a selec- 
f two paragraphs for each grade, which would eventually be 
for testing. Each of these paragraphs was given to approx- 
ly five hundred children. That is, a paragraph selected for 

v by a fourth-grade teacher was given to grade Iv, a 

ragraph selected for grade v was given to grade v, and so on. 

In no case was the paragraph selected for a given grade given to 


nv other grade. 
GIVING AND SCORING THE TESTS 


he tests were given by a group of normal school seniors who 
been trained to give them in a uniform manner. The pupil 
is given a sheet on which was printed the selection to be read. 
After this selection had been read once, and the time of reading 
recorded in seconds, it was collected and a four-page folder given 
each pupil upon which he was asked to write a reproduction of 
paragraph. After this reproduction was written, he was 
isked to turn to the last page of the folder and answer some 
tions based on the paragraph which had just been read. In 
ther words, the pupil was required to do four things: 


1. To read the selection once 
2. To record the time, 

3. To reproduce on another sheet all that he could remember 

4. To write from memory answers to questions based on the 
paragraph. 


The scoring of the reproduction was based on the number of 
ideas reproduced. What constituted each particular idea was 
ided upon previous to the correction of the test. In correcting 
the material it was very difficult at times to determine whether the 
idea had been reproduced by the pupil or not. In many other 
Ir instances it was perfectly clear that the pupil, instead of repro- 
lucing the paragraph which he had just read, brought into the 
reproduction many ideas based upon his experience. 
In correcting the reproduction wrong spelling was not consid- 
ered as an error. How much the inability to spell a word inter- 
leres with the ability to reproduce is not known, 
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RETURNS FROM GRADE IV 
The following was one of the stories given the fourth gr 
read and reproduce: 
Early one morning Washington left 
for himself what | soldiers were dol gins 
her was so cold that |} 


} 


TS WHO Saw 


e tall man passing by was their general, George Washing 


The following reproductions of the foregoing story illust 
how pupils weave into their reproduction extraneous idea 
have come to them through their experience. 


(reorges W ashingt mwas a bo 


lidn » him he had a uniform on him ani 


ling Goeoge Washtongton went ou 


t id saw 


i 


Lincoln in the window and said to him do you no me yes I do no y 


Washtongton 


In the first instance the pupil retains the ideas of 
Washington,” “a general,” “uniform,” “cape,” and “cay 
addition he has added the ideas of ‘“‘when he was a boy he 
lie.” In the second reproduction the only thing which was reta 
was that the story was about George Washington. Brin; 
in an idea, such as that of Lincoln, which has nothing to do v 
the situation is an interesting but not uncommon occurren 

Attention has been called to the fact that one source of error i 
misinterpretation of the meaning of individual words. TI! 
following reproductions of the same story show the misinterp: 
tion of the word “‘quarters”’: 


ne morning Washington left his quarters on the table and 

solde res wert 

ce Goerge Washington said he would go out to see what 
in th im|{ It was cold so he h 


He saw what his doildiers were doing. He said let us go out to camp 


id to put on his big v 


The first pupil shows that of the different meanings of th 
“quarters” he has selected the wrong one. He may hav 
this either through ignorance or through making a wrong 
tion of his experience due to failure to remember the 
between the phrases in the selection given. The second 
evidently has a very hazy idea of the meaning of this word 
possibly no correct meaning for it. 


cape. Lhe coat covered his untiorm, and nis hat and Cay] Not leay 
} +} 14 
of } face to | For this reasor S OO 
know that 
lie when grew 
Gengral no one 2 cape 2 
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RETURNS FROM GRADE VI 


w is given one of the selections given in grade v1 under the 


nditions and directions as used in grade Iv. 


seals make us think of young dogs and they play together like 


[The mother’s call to her lit 
t 


imil 4} ‘ 
ittie ones 1S similar to it ol sheen 


ing of alamb. When the rea it six 


allow pools and learn toswim. As they grow stronger 


l€ Y cry is like the | lea 
he gol to st 
wn into the sea and take excursions of miles The seals are so 


men are allowed to kill only a few of them 


Che seal hunter — bout seven feet lon 
ne seal nunters Carry Seve ec ng 


*y stun the animals by striking them on 


yng with sharp knives and kill then 


[he following is a reproduction written by an eleven-year-old 


baby seals resemble our dogs and puppies. There mother’s cry 


sheep W 


hen the, old the t i tank ¢ ] rn 
nen they are oid they are put in a tank to learn to 


When they are older they toss balls in a circus. 


ial teacner as useless. 


This reproduction indicates the importance of previous ex- 
;, Me perience. Such a piece of work is often discarded by the 
As a matter of fact it is a valuable means of 


termining what should be done for the pupil. The question to 


17 


answered is: ‘‘Why does the pupil bring in the ideas about 
tank and the circus?” It is the answer to this ‘““‘Why”’ that 


should guide the teacher in her future corrective work with the 


pupil 


QUESTIONS 


As noted above, a second part of the test consisted of a number 
f questions based on the selection read. The first question for 


fourth grade, wit 


h the answers which the department deemed 


ceptable and those which it deemed non-acceptable, is given 


below. Each of the non-acceptable answers was given by one or 


ore pupils. In all, 


Ac ceplable 
) see his soldiers 
to see soldiers in 


camp 
to see his men 
to see his army. 


42 percent answered the question correctly. 


“Why did Washington leave his quarters?” 


Not Acceptable 
because of his trail, to see a man, to go on 
an errand, on important business, it was 
cold, he was a general, he did not want to 
take it with him, he didn’t want to be in 
there, he had too much, they would not 
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know him, he died, he did not like it 
mother died, to look at himself, to see w 
they were doing, because he had t 
quarters are American money, he left it in 
pocket, because he wanted to, because t 
told lies, to go to fight the Germans, to 
a ‘feet’. 


Three types of answers are to be noted among the non-accept 

able: 

1. Those which apparently come from another part of the stor, 

Illustration: because it was cold | 
because he was a general 

2. Those which apparently result from a failure to use the right 
meaning of a word 

Illustration: the quarters are American money 
he left it in his pocket 

3. Those which apparently have nothing to do with the story 
but are based on outside experience 

Illustration: because his mother died 
because they told lies 
to go to fight the Germans. 
From the returns as a whole it was plain that the paragraph was 
Only 5 percent answered correctly the question ““What had Wash- 
ington ordered done?”’ Neither was this idea included generally 
by the pupils in their reproduction. 

In answering the questions on the story about the seals the 
sixth-grade pupils showed the same tendency to draw on their 
experience as was exhibited by the fourth-grade pupils. At one 
of the parks in Boston there is an aquarium where there are 4 
number of seals. The familiarity of children of the city with this 
aquarium was shown by the pupils of the sixth grade in their 
reproductions, and particularly in their answers to the fourth 
question: “Where do they learn to swim?’ when they wrote “at 
Marine Park.”’ 

Below are given the different answers to the first two questions 
of this selection—answers which seem to indicate again that the 
pupil draws largely on his experience to answer questions. If the 
experience suggested by the reading is more vivid than the mind 
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he gets from correctly interpreting the selection read, 
is to tell the story of that experience. 
“What do baby seals look like?” 

Acce plable Not Acceptable 
snails, beavers, bears, long and narrow, head 
of a rat and tail of a fish, fox, face like a rat 
and tail like a fish, gold, like tadpoles, base- 
ball bat. crabs, like big ones, bat, smooth soft 
skin, dark fur, cat, fish, very small, mice, 
monkey, lamb, long fur with spots for eyes, 
little cubs, Eskimos, tiger, hunter, dragon, 
walrus without tusks. 

“What does the young seals’ cry sound like?” 

b dog, cat, baby, loud cry, bird’s cry, cow, lion, 

ing o sheep. horn, bear, screech, deer, whistle, horse, dog 
when he watches, very big, like a ten-cent horn, 
saw, winds, lke a wake, groan, elephant, 
ma ma, goat, sweet, squeaky, hoarse voice, 
harsh, very loud noise, echo, walrus, shriek, 
wo'f, girl, when you sleep, whales, winds. 

he first question was answered correctly by 70 percent of the 

ip and the second by only 56 percent. Many answers show 

pupils did not even approximate the correct answer and yet 


he answer shows an intimate knowledge of the seal as an animal 
the aquarium. One who is familiar with the seal would not find 
it difficult to make most of the descriptions fit. 


SUMMARY 

One of the purposes of a standard test is to give the teacher in- 
ormation concerning her class and its individual needs. Al- 
though it is necessary to have reproduction, oral or written, in most 
branches of the curriculum of the upper grades as a means of 
judging whether the pupil has learned the lesson assigned, as a 
basis for standard tests it will probably never be practical. Such 
a test violates two important rules of educational measurement in 
that (a) the test is subjective rather than objective and (b) the 
task of correcting results is prodigious. 

On the other hand, answers to carefully selected questions 
yield as good a measure of pupils’ ability to read as does repro- 
duction, and the answers are easier to score. 
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In spite of these objections, however, there are certain adyap. 


tages in giving such a test, for it reveals that: 
1. Teachers cannot be depended upon to decide accurat, 
whether a selection is difficult or not—This should make t 
more lenient in their criticisms of the results of the pupils’ study 
2. It is the relation between words, phrases, and sente 
which makes the difficulty rather than the meanings of the in 
vidual words, phrases, and sentences 
3. There will be certain ideas in the selection that very 
pupils will be able to reproduce—These may be important or : 
4. The pupil will draw very largely upon his experience and 1 


be bound down by what he has just read. This gives the teacher 


a clue as to how corrective material should be used. 
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HE USE OF PSYCHOLOGICAL TESTS IN THE EDUCA- 
TIONAL GUIDANCE OF HIGH-SCHOOL PUPILS 


W. M. Procror 


Leland Stanford Junior Universily 


In a previous article’ the writer has shown that there is a very 
se relationship between intelligence level and the elimination 
pupils from high school. There are good grounds for the pre- 
tion that 75 percent of those who test below average, mentally, 
will fail in more than one-half of their studies during their first year 
of high school; that 50 percent of them will leave school to go to 
work during the first two years; and that none of them will remain 
graduate. The members of this group demand special atten- 
tion. If they are not carefully guided in the selection of their 
high-school work many of them will fail in all of their subjects 
during the first semester, with elimination as the inevitable result. 

Heretofore we have acted upon the assumption that the only 
way to discover the capabilities of high-school pupils was to per- 
mit them to try themselves out in various subjects of the high- 
school curriculum. It has even been a common practice to 
require all first-year high-school pupils to take an abstract subject 
ike algebra. Thus many a promising educational bark has gone 
down on the uncharted rocks of the first-year high-school 
subjects. 

Experimentation with psychological tests has now reached a 
stage where we can begin to hope that this wasteful trial and error 
method of procedure is to be discarded for a more scientific plan 
of educational guidance. No tests have yet been devised, either 
mental or pedagogical, which enable the adviser to chart unerr- 
ingly the educational possibilities of a given youth, but we have 
made sufficient progress in the science of mental measurements 
to be able to estimate with approximate accuracy the probable 
school success of a given pupil. The results of a practical experi- 
ment in educational guidance by means of mental tests will be 
described in the following pages. 

‘Proctor, W. M., “Psychological tests as a means of measuring the probable 


school success of high-school pupils,” Journal of Educational Research, 1:258-70, 
April, 1920, 
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FIGURE 1.—ILLUSTRATING DISTRIBUTION OF 8A? PUPILS BY | 
AND CHRONOLOGICAL AGES 


Chronolog- 16 Years 15 Years 14 Years 13 Years 


ical Age 4 Cases 7 Cases 8 Cases 12 Cases 


1. Conditions surrounding the experiment——The mid-year 8A 
class of the Palo Alto Intermediate School comprising 31 pupils, 
was examined with the Stanford-Binet Scale in January, 1918 
Figure 1 shows the distribution of intelligence quotients by chron- 
ological age groups. There were twelve thirteen-year-old pupils, 
eight fourteen-year-old, seven fifteen-year-old, and four sixteen 
year-old pupils examined. The lowest I. Q. discovered in the 
thirteen-year-old group was 110. All of the thirteen-year-olds 


In grade designations “A” means “second half.” 
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were, therefore, accelerated mentally. None of the fourteen-year- 
up fell below 95 I. Q. They were all at or above age men- 

One fifteen-year-old had an I. Q. of 90 and would be listed 

elow average”’ in intelligence. Of the four sixteen-year-old 
pils, all of whom would be accounted chronologically retarded, 
three had I. Q.’s of 88, and one an I. Q. of 96. That is to say, one 

‘ the sixteen-year-olds was normal and three would rate as “dull- 
normal.” 

Of the 31 members of the 8A class, 22 entered the Palo Alto 
High School in February, 1918. Four members of the class 
entered secondary schools elsewhere, two entered business colleges, 
two went to work, and one, a girl with an I. Q. of 88, eloped with 
a soldier from a nearby encampment. 

Only four members of this 8A class had earned I. Q.’s below 95. 
One of these, as just indicated, did not enter high school. The 
remaining three entered high school, but two of them dropped out 
before the end of the first year. The percentage of elimination 
from the class of those who tested below 95 I. Q. was therefore 
75.0. The one who remains in high school is making an average 
record in scholarship. She made a rating of “average” on an 
Army Scale test given a few weeks later, and has shown herself 
capable of diligent application to her school work. 

Each member of the class was questioned as to his or her voca- 
tional ambition, educational plans, and the subjects which he or 
she would like to take up during the first year of high school. 
These data, as well as results attained in Stanford-Binet and 
Army Scale mental tests, were recorded on cards. 

2. Use made of information gathered —The cooperation of the 
vice-principal and entering class adviser was obtained in order 
that the members of the 8A class might receive intelligent educa- 
tional guidance when they entered the high school. Duplicate 
sets of cards were prepared for the use of these persons. On 
registration day all the newly entered 8A graduates were referred 
to the vice-principal or the class adviser for help in making out 
their curriculums. No one was permitted to file a study card 
without this conference. 

Following are samples of the cards used in this experiment in 
educational guidance. The only change from the original is in the 
case of the name. 
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CARD NO. 1 
vane Chronological age 
Tyo 4 
} 
Score Army Scale Lt Stanford-Binet mental age: 
Army Scale mental age: Oo ¥rs., oO i 


Yyiwe 
. ? 


Army Scale I. Q Lo4 Stanford-Binet I. Q 


High school subjects which Educational plans 
5 t 


3 


pupil desires to take: 


y 


Vocational ambition: 1 


4a Stenograpn 


K K ¢ 


Grade of work done in intermediate and grammar schools 
and 


Comment of Examiner: 


possible for her to go on to college as well as to carry out 
ambition to become a stenographer. She took up: Englis 
German, algebra, and typewriting. During the first semester o/ 
her high-school course she made an average of “B”’ in all of h 
subjects. 

Card No. 2 relates to Mary Jones who took exactly th 
subjects outlined on her card, except that being a first-yea 
pupil she was permitted to take four subjects only and had to 
wait until her second year for drawing. At the end of the first 
semester in high school she had earned three “‘A”’ grades and a 
“B+,” with an average of 93 percent. 

Here was the case of a girl with very superior ability as indicated 
by two different mental examinations, by her school record and by 
the estimates of her elementary and intermediate school teachers 
She gave evidence of being an independent thinker, of knowing 
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CARD NO. 2 


~ 


3, Mary Chronological age: yr 
Score Army Scale 1485 Stanford-Binet mental age: 
19 vy 
1 yrs., « mo. 
Army Scale, mental age: 
mMDA 
Army Scale I. Q 1 Stanford-Binet I. Q J 
High school subjects which Educational plans: 
ipil desires to take: 4 rinisn nig 
lgebra a university or 
+ y rma) sch 
history Vocational ambition: JC 
LA + . 


Grade of work donein grammar and intermediate schools: “A 


Comment of Examiner: ANLOWS wnert sn 
Wf “rT l«r ~yy 4+ 4 7 + 
a ~ A 
» 4 
wil LY A AY 
L1irst Il afl ¢ Wid 


just what she wanted to make of herself, and just what she would 


r of have to do by way of preparation. The necessity for educational 
Ther and vocational guidance in her case might well be questioned. 
However, it was a real advantage to her teachers to know at the 
the very beginning of her high-school career the quality of her ability 
year and something of her life plans in order that they might give 
1 to immediate and sympathetic cooperation. Without this knowl- 
first edge they might have made the mistake of holding her back to the 
id a pace of the ‘‘average”’ pupil. Fortified by the facts relative to her 
mental gifts and vocational ambitions, she is to be permitted to 

ited complete her high-school course in three years. 
| by There is just as much danger that the bright pupil will not be 
ers given enough to do, as that the dull pupil will be given tasks that 


ing are too difficult to perform. 


wat 
| 
| 
| 
| 
| hor 
é 
| 


JOURNAL EDUCATIONAL RESEARCH 


CARD NO. 3 


Chronological age: 


Score Army Scale... 15C Stanford-Binet mental age: 


Army Scale mental age: 1 
ry _ A 


mr 


vy) 


Army Scale I. Q 120 Stanford-Binet I. Q 


High school subjects which Educational plans: 


pupil desires to take: fit 


4% 


Lit 


Vocational ambition: 


» of work done in elementary and intermediate schools 
Da +4 + a0 Wa 


ana as 


ro ror 


Comment of Examiner: DC 


The boy whose card is set forth above enrolled for English, 
algebra, history, and general science, upon entering high school 
During his first half year he made grades of “C’’in English, and 
“B”’ in each of his other subjects. This was a great improvement 
over the grades earned by him in the eighth grade. A recent 
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ing up shows that he has brought up his English grade and 
intaining college recommendation standing in all his work. 
ntal tests were an aid to his advisers in discovering how to 

-yyr him on to creditable achievement in his school work. 
CARD NO. 4 


wn, arrie Chronological age: Yrs. 
re Army Scale... 4 f mo, 
\rmy Scale mental age: Stanford-Binet mental age: 
1A wre moO 14 wre 
Army Scale I. Q ok, Stanford-Binet I. Q 
High school subjects which 
pil desires to take: Educational plans: 
gebra lleg 
Vocational ambition: 10 D€ 
rr v7} miat 
ping a Unemist. 


Grade of work done in intermediate and grammar schools: 


a4 A ~ + a4 J A. ~ > 
4 4 anh = + 
A + + . 
Comment of Examiner: + lia { 

aron aa aline 2 \ 

+ + + AL 4 
4 A A + 4 + 4. 
~ ~ + q 4 + ~p 
> Ad A V 4 . 


The program finally worked out by Carrie Brown and the class 

adviser included English, algebra, free-hand drawing, and typing. 

lish. Her grades at the end of the first semester in high school were: 
acl English, “C’”’; algebra, “E” (failure); free-hand drawing, “C”’; 


and typing, “B.” She had failed in algebra, the subject counted as 


ent doubtful by the examiner, and had earned less than college recom- 
ent mendation grades in the only other subjects that would be counted 
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toward entrance to Mills College. Even if she completes hig: 
school her chance of continuing in college is not at all bright. 

A sufficient number of sample cards have been described ; 
illustrate the method employed. There was no coercion. ( 
and advice in the selection of subjects were all that was attemp; 
but the counsel and advice offered were based on all the s 
ficant information with regard to mental ability, school su 
vocational ambition, and teachers’ estimates of ability, that 
be obtained. Certain pupils elected to take subjects which 
advisers felt sure they would fail in and made passing gra 
Others taking subjects on the advice of the counselors 
Such cases simply illustrate the truth that no human agency, } 
ever fortified with information or however careful to mix comn 
sense with theories, can hope to be infallible. The general res 
of the experiment, however, were very satisfactory. 

3. Results attained by “guided” and “unguided” high-school 
pupils —The original group of 107 high-school pupils which en- 
tered the Palo Alto High School in September 1916, were exami: 
with the Stanford-Binet Scale after entering high school. T) 
had already selected their courses of study at the time of | 
examined, hence can properly be designated as “‘the unguid 
group. A comparison of the first year’s work done by the mem 
bers of the “unguided” group with the work done by the group 
that entered high school in February, 1918, and which had the 
benefit of counsel based on mental tests and other signiticant 
data, will illustrate the value of careful guidance as against th 
trial and error method of selecting high-school courses of study. 


TABLE I. COMPARATIVE FACTS REGARDING “GUIDED” 
AND “UNGUIDED”’ GROUPS OF HIGH-SCHOOL PUPILS 


Group | Outat Per- | Out by | Per- Failed Per- | Failed 
Work | cent | Transfer | cent |1 Subject! cent |2 or More 


Guided 1 4.5 2 9.0 4 18.0 | 0 
Unguided 13 12.0 14 13.0 33 | 31.0 | 11 


It is not exactly true to fact to designate the original grou; 
107 as the “unguided” group. Most of them had been examined 
with the Stanford-Binet before the end of the first six-week period. 
Whenever the results of the first six weeks of school work con- 
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S high srmed the indications of the mental tests that a pupil would prob- 

y fail in such abstract subjects as algebra, Latin, etc., that 

:pil was permitted to drop the subject and continue the semester 

ying but three subjects. The subject dropped at the end of 

first six-week period was not counted as a failure in compiling 

Signi- the data for Table I. The mental tests were utilized to aid in 
rrecting the mistakes made by the pupils in the unguided sele 

tion of their subjects. To this extent, then, the original group 

was guided, but the guidance came after, not before school work 

s begun. 

[he number of failures registered against the “unguided” group 
it the end of their first year in high school would undoubtedly have 
been greatly increased if it had not been for the limited guidance 
tbove described. This fact gives greater significance to the data 
presented in Table I. 

The median I. Q. of the unguided group was 105, and the median 


h en- I. Q. of the guided group was 108, a difference of three points in 
ined favor of the guided group, but this is not in itself an adequate 
Chey explanation of the superior record made by the guided group dur- 

being ing its first year in high school. 

ided Che most significant facts to be found in Table I are those relat- 


ing to number of failures in one subject, and in two or more 
jects. It appears that 31.0 percent of the unguided group 


1 the failed in one subject, and 11.0 percent failed in two or more sub- 
cant jects during their first year in high school, while of the guided 
+ the group only 18.0 percent failed in one subject and none of them 
ly. failed in two subjects Since it has been shown that failures in 


school work tend to increase the percentage of elimination it is 
reasonable to attribute the small percent of elimination due to 
leaving high school to go to work, in the case of the guided group, 
to entire absence of failures in two or more subjects. 

The results of the above described experiment in educational 
guidance by means of mental tests would seem to justify the con- 
clusion that such tests may be of material assistance to the high- 

; school administrator, if used in connection with other significant 
data. It is certain that the methods applied in this instance, if 
employed in any high school, would prove greatly superior to the 
wasteful “trial and error’? methods that now prevail. 

4. Relation of general level of intelligence to success in a given 
subject—In Table II is shown the correlation between general 
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level of intelligence and high-school grades in algebra 
algebra grades are recorded under the letters A, B+, B, C 
D, and E. The I. Q.’s come under the groups 84-89, 

95-99, etc. 


rABLE Il. CORRELATION BETWEEN I. Q.’S AND GRADES 
IN ALGEBRA OF 113 HIGH-SCHOOL PUPILS 


0.05 


The correlation obtained, 0.46, which is nine times the pr 
able error can be counted as having considerable significance. 


examination of the data contained in Table II will show 
twelve of the fifteen failures in algebra, or 80.0 percent of th 
number of failures, were earned by pupils with I. Q.’s below |! 
There were 35 pupils having I. Q.’s below 100, and 26 of th 
74.3 percent earned marks below “B,” which is the colleg 
mendation grade in California. On the other hand there w: 
pupils with I. Q.’s above 100, and 45 of these, or 63.0 per 
earned marks of “B” or above. An I. Q. of 120 or over det 
very superior intelligence. There are 25 cases with I. Q.’s | 
overin Table II. All of these succeeded in earning passing gr: 
in algebra. Only one received a mark as low as “C—.” 
High-school statistics show that algebra is responsible for m: 
failures of first-year pupils than any other subject. Tabi 
suggests that probable success or failure in algebra can be inierr 
from the general level of intelligence as disclosed by mental tests 


1} 


It follows that the high percentage of failure in algebra could be 


Aleebr I. Q.’s (STANFORD-BINET) i 
Grades SO-| 85-| 90-| 
84) 8&9 | 94 | 99 1104 |109 [114 1124 | over | 
A 2 1 3 0 1 1 3 11 : 
“B+” 1 2 2 5 
ws 2 2 3 7 3 7 5 5 2 
“co” | 7] 4 5 6 2 5 3 3; 3 
on | | | | | | 
C- 1 1 
Totals 11/16} 114911 14 11 
Correlation (Pearson): 0.46 
Probable error: Sl 
} 
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materially reduced if only those were encouraged to take the sub- 
C-. t whose general level of intelligence measured up to average or 


5. Relation of score in a particular mental test to success in a 
siven high-school subject—Test No. 9, in Army Scale, Group 
Fyaminations @ and 3, is a “‘word relations” test. It involves a 
knowledge of word meanings and also the ability to use words 
intelligently in their proper relations to one another. Table III 

npares the scores made by 171 first-year pupils of the Palo Alto 

High School in Test No. 9, with the grades made by the same 
pupils in English during their first high-school year. 
' The directions for giving the test are as follows: 
h of the lines below, the first two words have a certain relation. Notice 
n and draw a line under the one word in the parenthesis which has that 
lar relation to the third word. Begin with No. 1 and mark as many sets as you 
re time is called. 
IS Sample sets are then given by the examiner to illustrate what 
is wanted: 


blue: grass—(grow, green, cut, dead) 


swims: man—(boy, woman, walks, girl 


night: white—(red, black, clear, pure 


‘. oe TABLE III. CORRELATION BETWEEN GRADES IN ENGLISH AND 
SCORES IN GROUP INTELLIGENCE TEST NO. 9 OF 
ARMY SCALE, OF 171 HIGH-SCHOOL PUPILS 


w 100. Marks in Scores in Test No. 9, Examinations a and 6 
First Year | 1- | S- | 20 25-4 30-| 35-| 40 [Total 
English 4 |9 | 19] 24 | 29 | 34 | 39 
| 1 4 1 3 2 11 
1} 1] 7/14] 10] 2 35 
120 or 3 9] 17 17 8 6 2 62 
2 D 1 1 2 
more Totals....... 3} 11 | 24 | 46 | 43 | 32 | 12 | 171 
lerred Probable error: 0.04 
13 “a There were forty sets of words and the time allowed was three 


minutes. For purposes of tabulation the scores made by the 


| 
sky — | 
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pupils are grouped: 1-4, 5—9,... 35-39, The English g 
are indicated by the letters A, B+, B, C, C—, D and E. 
The correlation, 0.478, is twelve times the probable erro 
indicates that a good score in the “‘word relations” test is a { 
good index of ability in first-year high-school English. 
in English were the final year marks, which represent the mini 
of “‘D’s” and “E’s,” because all conditions and failures had 
removed that could be made up. The median score in Test 
was 26, hence scores of 30 or over could be considered sup 


There were 44 pupils who made scores of 30 or over, and 36 of | 


or 82.0 percent made marks in first-year English of “B”’ or 
Of the 89 who made scores of from 20 to 29 inclusive, 68.7 | 
made marks in first-year English of “B” or above. Whil 
38 who made scores of from one to nineteen inclusive, only 
percent made marks of “B”’ or above. 

Stated in terms of recommendation for coilege the above 
sis of the data of Table III means that 76.3 percent of the 
school pupils whose ability in word relations is represented 
score of less than 20 fail to secure a college recommendation ¢ 
while only 18.0 percent of those who attain a score of 30 or 
the same test fail to secure such a grade. 

These results seem to indicate that a series of tests invol 
the fundamental traits of mind essential to the successful st 
English could be devised. But there are so many mental trai 
involved in the mastery of the subject of English that a series oi 
tests bringing into play all those traits would undoubtedly | 
found to be a good test of general intelligence as well as a tes! 
specific ability in English. 


SUMMARY AND CONCLUSIONS 


1. The results of an experiment in educational guidance, in 
which all the members of an 8A class about to enter high school 
were given mental tests and advised with reference to their first 
year high-school work, proved very satisfactory. Compared with 
an unguided group it was found that while 31 percent of the un 
guided group failed in one subject, and 11 percent failed in tw: 
subjects during their first high-school year, only 18 percent of the 
guided group failed in one subject and none of them failed in two 
subjects. The mental tests aided in the discovery of the pupil’s 
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general level of intelligence, made possible the giving of sound 
cational advice at the time when it would do the most good, 
and thus tended to reduce the percentage of failure and 
ination. The methods employed can be adapted to the 
needs of any high school. 

2. The general level of intelligence is shown to have real signif- 
nce as a means of predicting success in a particular subject, 
h as algebra. In Table II it was shown that 100 percent of 

having I. Q.’s of 120 or over passed in their algebra, while 
40 percent of those with I. Q.’s below 100 either failed or were con- 
ditioned in algebra, and only 20 percént of the members of this 
group earned college recommendation grades. “The general level 
of intelligence could be relied upon as a means of selecting those 
ho would be most likely to succeed in algebra and kindred sub- 
jects. 
~ 3. Success in a particular test of a series may be a fairly reliable 
index of success in a high-school subject involving the mental 
traits supposed to be measured by the test in question. High 
scores in the “‘word-relations”’ test of the Army Scale, Examina- 
tions a and 6, correspond generally to high marks in first-year 
high-school English, while scores below twenty in the same test 
correspond generally to low marks in the same subject. 

4. Mental tests for purposes of prognosis in individual high- 
school subjects such as algebra, English, etc., could no doubt be 
devised. But the mastery of any high-school subject involves 
such a complex of mental traits that any test which proves to be a 
good test of ability to succeed in one subject is quite apt to be 
found a good test of general mental ability. It has already been 
shown that a high-school pupil having a high level of intelligence 
will probably succeed in all of his subjects, and conversely that 
a pupil having a low level of intelligence is apt to fail in most of his 
high-school subjects. The best way, thefgfore, in which to arrive 
at an estimate of a given pupil’s probable success in a specific high- 
school subject is to discover the general level of his intelligence. 
It follows that standardized mental tests may render invaluable 
service in the educational guidance of high-school pupils. Partic- 
ularly will this be found to be true if the results of the mental test 
are interpreted in the light of other significant data, such as 
school marks made in previous grades, teachers’ estimates of 
ability, and educational and vocational plans. . 
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THE OPERATION OF BUREAUS OF EDUCA- 
TIONAL RESEARCH—WITH PARTICULAR 
REFERENCE TO WISCONSIN 
W. W. THEISEN 


State Department of Public Instruction, Madison, Wisconsin 


A remarkable development in scientific methods of studying 
educational problems has taken place within the past few years 
a development which has made it possible for well-inform 
persons to know more fully and accurately than ever before th 
possibilities and limitations of educational improvement. 

The evidence of this development may be found in many 

types of material, e.g., in numerous published surveys, schoo] 
reports, reports of educational conferences, bulletins of bureaus 
of research, scores of recent educational monographs, and hun- 
dreds of magazine articles. Our methods of treatment of th 
statistics of attendance, progress and promotion, courses of study, 
teaching personnel, buildings and equipment, and finance have 
been greatly improved; while more noteworthy than any other 
has been the advance in the technic of measuring the achieve- 
ments of pupils. 
+ Unfortunately, however, the utilization of these scientific 
methods is still far from common in school practice. Moreover 
the knowledge of what has been done and can be done in educa- 
tion is still largely the possession of a few. The problem now is 
to make these methods and this knowledge widely available and 
practically effective. To accomplish this the results, methods 
and spirit of investigation must be put into operation in every 
school. 

The so-called bureau of research is the most active and 
effective agency today for making these newer developments a 
part of our practice. Without the intelligent direction and 
supervision of such an agency, teachers and administrators will 


not benefit to the fullest extent from our advance in scientific 
methods. Scientific supervision of this sort enables the weak 
schools to gain strength and the strong to grow still stronger; 
makes the successful activities of one school available for others; 
and develops teamwork among schools. Incomparably more 


382 


BUREAUS OF EDUCATIONAL RESEARCH 38 


tive are the united efforts of such schools than the spasmodic 
ts of single schools. It is the function of bureaus of school 
h to provide supervision of this kind, and to bring about 
large area the application of scientific procedure to problems 
ministration, supervision, and teaching. School systems that 
installed research bureaus have come to stand out in 
.d contrast with others that have failed to do so 


hls MEASUREMENT OF INSTRUCTION AS A BUREAU PROBLEM 

Car 

orn [he problems that should command the attention of bureaus 

re t esearch are many. One of the most important is the problem 
pplying scientific procedure in measuring and improving the 

man t of instruction. At present only a comparatively few 

chon ils and teachers can be expected to proceed unaided. 

reaus [hose who can, will nevertheless lack the stimulation which 

‘sen results from a knowledge of the success of others in wrestling with 

f th the same problems. The need of supervision of educational meas- 


"i urement in this restricted sense arises fropa another source. 
iny of our school systems, city and state, are deficient in the 
amount of helpful supervisory aid which they can give to teachers. 
Educational measurement furnishes a very fruitful instrument of 
supervision. With a comparatively small expenditure of money, 
1 large number of schools and teachers can be effectively reached. 


— 


ntinc 
co This fact has undoubtedly had its influence on the rapidity with 
luca- which bureaus of educational measurement, or research, have 
vw is leveloped. Such organizations ought soon to be found in every 
ind state and in every city of large or moderate size. 
ds Educational measurement on a large scale involves the co- 
very operation of superintendents, principals, and teachers. It is 
the task of bureaus of research to build up such cooperation. 
and To secure it requires well-directed efforts on the part of those in 
its a charge of the bureaus. In the first place, it should be assumed 
and that the large majority of superintendents, principals, and 
will teachers are progressive at heart, that they earnestly desire to 
tific know how they can improve the quality of instruction, and that 
veak they will decide upon a wise course of procedure, if the facts are 
wer: clearly presented. In the second place, it will be necessary to 
ers: make a clear presentation of the merits and possibilities of educa- 
nore tional measurements, and in doing so there will be abundant 
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opportunity for the employment of tact and good judgm 
Moreover, the supervisor or director in charge must m 
first-hand contact with the schools through field work. Wit} 

it he will not be in a position to realize the possibilities 
limitations of local schools and teachers, nor can he prescri 
accurately for their improvement. This is exceedingly importan; 


in all the bureau work of a state department or university. 
Che attitude of those whom the director hopes to reac! 

depend upon their previous acquaintance in the field of edu 

tional investigation and measurement. For convenience w 


divide school heads and teachers into three groups: Group | 
those partly acquainted with educational measurements and their 
uses, as a result of what they have read or have heard on various 
occasions; Group II: those wholly, or almost wholly, unfamiliar 
with the newer developments in educational investigation; and 
Group III: those who have had considerable experience 

their application. The director’s efforts to stimulate educational! 
research will differ in each of these cases. 


Group [. THoset PARTLY ACQUAINTED WITH EDUCA 
rlIONAL MEASUREMENT 


Most superintendents even in states which do not support 
bureaus of research, are partly acquainted with educational 
measurements and their uses. They are, therefore, for the m 
part in a receptive mood. Although they are often eager 
begin actual investigation, they, nevertheless, hesitate because 
of unfamiliarity with the details of procedure and lack of conti- 
dence in their own ability. In such cases, the presence of the 
supervisor or director is all that is needed to set the movement 
on toot. 


In visits to schools of this type, the director must adopt 
sympathetic attitude. He must endeavor to find out what the 
schools have tried or are trying todo. By so doing he will discover 
wherein his own services will be of most help. Among other 
things, he should make inquiry as to the superintendent’s plan 
for the professional development of his teaching staff. Again, he 
should learn what subjects of the curriculum are being attacked 
with a view to improving instruction. The services of the director 
will usually be most welcomed, if he exhibits a desire to aid in 
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gment urying out the superintendent’s plans. With this point as a 
eginning he will be in a position to make recommendations for 
ithout additional lines of investigation. 

eS and Where such schools have already planned to make some appli- 
escrl tion of educational measurements, they will welcome the 
Ortant rector’s aid and guidance in the details, such as administering 


and scoring and tabulating the results. While we do not 
ve that much of his time should be spent in this fashion, such 
edu sistance is often quite necessary in new fields. As far as possible, 
ver, his time should be given to interpreting and teaching 
rs how to interpret the results attained, assisting teachers 
the finer diagnostic analysis of results, making suggestions for 
arious remedial work, and planning for further experimentation. By 
iliar means he should make it a point to meet teachers and princi- 
pals individually and in groups. The findings and suggestions 
ce | can then be made the subject of discussion. It is very important 
tional! at teachers be made to feel that their use of measurements must 
top with a compilation of results, and it is at this point that 
ervices of the director are most needed. Without construc- 
guidance much well-intentioned effort is apt to count for 

cht. 

Where the supervisor or director finds it impossible to be 
ional present in person, he can assist materially through correspondence 
most When he is asked for information on such matters as school 
iiding standards, grading and promotion standards, available 
sts in various subjects and suggestions as to their use, he is in 
position to help superintendents or principals to proceed wisely 

the and to steer them away from pitfalls. In the case of tests, he 
ment should ask in each instance that a copy of the results be sent him 

for examination and criticism. 

Group II. THos— UNACQUAINTED WITH EDUCATIONAL 
MEASUREMENT 

, Every director, particularly in a new field, must expect to find 
some superintendents, principals, and teachers who are to all 
intents unacquainted with educational measurements and their 
ss significance. He should endeavor to reach as many of these as 
possible, thus recruiting the ranks of those better acquainted with 
the field. There are several avenues and instruments of approach 
that can be used to good advantage, e.g., conventions of superin- 
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tendents and principals, teachers’ institutes and other edu 


gatherings and the columns of state educational publicati 

The most fruitful reward of effort in this direction 
before, from personal visitation. This offers opportunit 
“talk things over,” to tell what has been done elsewher 
samples of standard tests, to tell how they may be used, | 
out their merits and demerits, to indicate the benefits to bi 
from their application, and to suggest lines of investigati 
this part of the work is well done, it will usually result i: 
invitation to undertake some experimentation, to suppl: 
standardized tests, or possibly to meet with the teachers a1 
plain to them the uses of such tests. New bureaus will find t 
type of field work advisable whenever it is at all possible. 

Group III. THosrt ExXperreNCED IN EDUCATIONAI 
MEASUREMENT 

In schools that have already made more or less use of sci 
methods of attacking educational problems, the director’s effor 
can be centered upon an analysis of some of the results and t! 


implications. It should be his business to see, for examp! 
the diagnostic phase of testing is properly understood and er 
sized. It will be a part of his task to demonstrate from th¢ 
papers of the children the diagnostic values and possibiliti 
the tests used, to suggest forms for tabulating and eflecti 
representing the findings, to indicate possible needed revisi 
in teaching method, course of study, or gradation of pupils 
propose additional equipment in the way of books, maps, 
for testing, practice materials, etc., and to plan lines of 
research and experimentation. Clearly, the director should 
good general supervisor of instruction. He will often 
impossible to give each school all of the personal attention 1 
needs. If, however—as in a state department—there are gene! 
supervisors of instruction at work out in the field, they can 
instructed and enlisted to aid in carrying out remedial measu! 
in local schools. Their cooperation will be extremely valuable. 
Not too much should be expected of schools at the start 
the first place, it is not advisable to attempt many lines of iny 
gation in a given school system, particularly if several of 
affect the same teachers. When standardized tests are appli 
is well to confine the testing to one subject at a time. Karel) 
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uld more than two be attempted simultaneously. If too 
ny tests are undertaken, confusion results, and the satisfactory 
tment of any one of them is difficult. The professional ener- 
cies of the teaching staff should be organized for a “drive’’ on the 
subject chosen. Not until its objectives have been reached should 
ther subjects be attacked. In Wisconsin it has been the practice 
in most instances to set the dates for successive cooperative tests 
so that a period of two months or more may intervene between 
tests in different subjects. Arithmetic may be tested in Novem- 
ber and reading in February. This allows the teachers and 
principals some time to work out remedial measures. If we may 
be permitted to offer a criticism upon our own work, it is that 
during the first year we failed to allow sufficient opportunity for 
this sort of concentration. In the second place, simple tests 
should be selected for use in all schools that have had no previous 
experience with tests, or experience of a very limited kind. In 
such schools, the many administrative details connected with 
the more elaborate tests only serve to obscure their real purpose. 
AFTER THE WorK HAs BEEN WELL STARTED 

The program outlined thus far has to do with the initial 
building of a foundation for educational research, After a group 
of superintendents has been trained to proceed with research 
and experimentation, the work of the director becomes somewhat 
different in character. If possible, an annual conference of school 
heads should be arranged. A number of states now hold such 
conferences, the best known being those held at Indiana Univer- 
sity. At such gatherings the results of previous efforts can be 
reviewed. Matters for cooperative investigation proposed for 
the year can be discussed and voted upon. At such times it is 
the business of the director to bring to the attention of the 
assembled school heads the most recent developments in scientif- 
ic procedure in education, and to call their attention to the best 
recent literature on the subject. If possible at this time, it will 
be well to bring before the conference some prominent workers 
in the field of educational research from the outside, who are 
capable of stimulating further educational investigation and 
professional growth. After a few days of wholesome discussion 
the director’s suggestions and those made by superintendents 
and others can be finally considered and lines of investigation 
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voted upon. Superintendents should be made to feel that 
choice is their own. Dates that are opportune should be . 


A bureau of research should at all times act as a so 


information for teachers, supervisors, and superintendents 


questions relating to the most effective methods in t 
supervision, or administration. A part of its function is to s 
gest the most recent studies of practical value, to issue revi 


stimulating and suggestive articles and monographs in th 


of education, and to send out bibliographies of the best pul 


tions pertaining to problems under investigation 


EDUCATIONAL MEASUREMENT IN WISCONSIN 


Organized work in educational measurements in the sch 
the state began in the fall of 1916 with the appointment 
director of educational measurements by State Superinte: 
C. P. Cary. Previous to this, the efforts to carry on educati 
measurements in the state were quite meager and more or 


ae spasmodic. Since then a definite policy of cooperative « 
tional investigation of school conditions has been pur: 
Superintendent Cary’s main purpose in establishing the bur 
of educational measurements was to bring about a general 1 
provement in the achievements of pupils throughout the t 
i It was his belief that instruction lacked the quality of thorou; a 
48 ness which should be demanded. The results of investigations t 


to date have fully substantiated this position. 

While attempting to carry out the purpose just mentio 
the bureau does not limit itself to efforts at improving the 
of classroom teachers and supervisors directly. It seek 
improve administrative procedure and educational conditi 
General school surveys and surveys of particular phases oi local 
school problems are undertaken. The Janesville survey has 
been published as an example of a general survey. Among 
other things, efforts are made to secure increased financial sup] 
for schools, more economical distribution of school funds, bett 


buildings and equipment, higher salaries for teachers, selection 
better trained teachers, and improved gradation of pupils 
With the exception of the tests applied in cities during 
first year, standardized educational tests have been given chietly 
on a cooperative basis, made possible through the gene! 
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onse of two bodies—one the city superintendents and the 
er the county superintendents and supervising teachers. 
Each group is met annually in conference. At these conferences, 
ns are taken up for cooperative testing for the year. In addi- 
to the groups mentioned above certain other groups, such 
teachers in state normal schools and those in the county 
ing schools for teachers, are called upon at times. 
[he schedule carried out since the bureau has been in operation, 
classes and numbers of schools reporting complete results, and 
numbers of children tested may be seen in the accompanying 


[he foregoing tabulation by no means represents all of the 
ting done during this time. It usually happens that a number 
chools find it inadvisable or inconvenient to give the tests at 
particular time set, and that others make incomplete or late 
returns, or make no returns at all. Many schools give a number 

f tests in addition to the cooperative tests, depending upon the 
nature of the local problem. With the aid of the bureau a number 

ve been making use of group intelligence tests. Superintendents 

becoming more and more alert to the necessity of more 
curate classification and gradation of pupils. During the year 
1918-1919, the bureau administered its own group intelligence 
tests to students in seven of the state normal schools, as a means of 
aiding the normal schools in studying the quality of the prospec- 
tive teaching material. 

In addition to the testing, an increasingly large number of 
schools are engaging in definite experimental studies of special 
phases of instruction. During the current year intensive remedial 
work in reading is being emphasized more than any other topic. 

The state supervisors, in their visits to schools, are using the 
facts discovered through the application of tests. They meet 
teachers, principals, and supervisors individually and in groups. 
At these meetings they discuss the test results and their applica- 
tions to teaching method, course of study, equipment, and 
gradation of pupils. This personal contact of the state super- 
isors with the teachers—a contact in which the teachers are 
elped to make the applications—is an essential and vital part 
of the work as it is carried on from the Wisconsin State Depart- 
ment of Public Instruction. 
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1916-1917! 


Spelling Ayres 
Writing rhorndike 


SUMMARY OF COOPERATIVE EDUCATIONAL TESTING IN WISCONsry 


1173 schools 


small village Spelling Ayres 132 
“State graded” | Writing | Thorndike 9 
City Spelling | Ayres 35 cities 
Arithmetic | Woody-A | . 
| Reading Kansas | ig _' 
Writing Thorndike 11 
| Composition} Hillegas, Trabue 15 
1917-1918 
Rural | Arithmetic | Stone-Original 27 counties 
* Arithmetic | Woody-A 31 
City Reading | Thorndike Alpha 2 34 cities 
Arithmetic | Stone-Original 
| Equivalent | 
Algebra | Hotz 
1918-1919 
Rural Spelling | Buckingham 45 counties 
= Re ding | Monroe 43 
City 32 cities 
4 Arithmetic | Theisen-Woody 29 
Latin | Brown | 
Co. training and} (Reading Thorndike A 50 schools 
teacher training Rate 41 
classes in H. S } Arithmetic | Woody 48 
= Stone 44 = 


1919-1920 


City Spelling | Ashbaugh-lowa 

ns Reading | Monroe Form II 
History | Van Wagenen 

Rural Arithmetic | Theisen-Woody 


! During the first year, 1916-1917, the tests in cities were given at the tim: 


director's visit. In succeeding years a definite date was fixed for the giving of t! 


in all schools. 
* Returns are just now coming in. 


* To be given during the present 


114? cities 
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attention is given to the training of prospective teachers 
use and application of standardized educational tests. 
rs should possess at least a preliminary understanding 
ppreciation of the purposes and values of such tests when 
enter upon their duties. State normal schools are urged to 
urses giving specific training in the application of stand- 
| tests. The state supervisors of educational measurement 
st in the preparation of such courses. A number of Wisconsin 
normal schools now offer training in educational measure- 
either as a separate course or as parts of other courses in 
ion. 
personnel of the bureau includes, in addition to the director, 
sistant director, Mrs. Cecile White Flemming, Supervisor of 
tional Measurements, and a statistical secretary, Miss 
beth A. Ahern. Besides the immediate staff the bureau has, 
s been said, the benefit of the cooperation and assistance of 
embers of the staff of the State Department of Public 
truction. Temporary clerical and statistical assistance is 
ired from time to time to aid in busy seasons and when material 
requested by superintendents is to be prepared. It is to be re- 
tted that sufficient funds are not provided for clerical assistance 
permanent sort. This need is sorely felt by reason of the fact 
many schools look to the bureau as a clearing house for 
rmation on such matters as comparative salaries, comparative 
ol costs, school buildings and equipment, comparative figures 
standard tests, age-grade statistics, etc. 
\side from its direct service to Wisconsin schools, the bureau 
the state department is called upon from time to time for 
estions for the application of educational measurements 
| the development of new bureaus in other states. No doubt 
ther bureaus have had many similar requests. Such requests 
ire an indication of the growing demand for the application 
{ scientific methods of procedure in educational administration 
and supervision. 
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PUTTING STANDARDIZED TESTS AND SCALES 
TO PRACTICAL USE IN THE RURAL SCHOOLS 


SAMUEL 8S. BROOKS 


District Superintendent, Silver Lake, New Hampshire 


A supervisory district containing 26 rural, ungraded one-r 
schools with teachers for the most part inexperienced or unt: 
a majority of whom had never worked under a superintend 
fore this, was the opportunity that fell to my lot when I beca: 
New Hampshire superintendent under the new law et 
September 1, 1919. It was my first experience as a superintend- 
ent. Truly the district was “virgin soil” as a member of 
state department remarked to me when I took the position 


SIZING UP THE SITUATION 


The first two or three weeks were spent in traveling about the dis- 


iS trict getting acquainted with the teachers and sizing up the sit 
ation. Most of the schools had already begun, the teachers having 
i been hired by the local school boards as in the past. I found t! 


three of the teachers were normal-school graduates, and that 
had attended one summer school; but the others had no professio1 
training whatever. Several had not attended school beyond t! 
eighth grade, but had taught from ten to 28 years in the s: 
school. Three were inexperienced high-school graduates in 1 
‘teens. Fifty percent of all the teachers had never seen a profes 
sional book or magazine and did not know where to obtain 
All this of course had resulted in an ingrowing provincialism which 
could not but have a disastrously narrowing effect on their teach 
ing. They were imitators of imitators. Their methods were in 
imitation of the teachers who had taught them and who, in their 
turn, had imitated their own teachers. The results were the use o! 
methods and texts so archaic as to be amusing if they had not been 
at the same time such a sad commentary on our boasted educa 
tional system. 

' This is the first of a series of articles describing some of the problems confronting 
an inexperienced superintendent of a rural district in New Hampshire and his 
to solve them with the help of standardized educational tests and measure! 
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Most of the textbooks were sadly out of date. Arithmetics, 
raphies, grammars, and even histories published in the 
ties were in daily use. One of the local committees insisted 
they must be good books or they would not have worn so 

Of course the books were all based on the defunct doctrine 

‘formal discipline and showed little of the psychological methods 

senting material which are the basis of modern educational 

ure. The idea seemed to be that an arithmetic is an arith 

, and a geography is a geography and that one book is as 

as another so long as nothing pertaining to the subject is 
itted and the leaves are all present. 

| have emphasized the teaching and textbook situations because 
nsider them the most important factors. A few other points 

[ shall mention briefly. As for the schoolhouses, it is sufficient to 
y that most of them were typical New England rural school 
iidings of ancient vintage, modelled variously (according to the 
idea of their instigators), upon churches, town halls, barns, and in 
cases it would almost seem, upon pigpens. They were 
ul, dirty, poorly heated, lighted and ventilated, and in short 
rally unsanitary and ill-suited to their purpose. As to the 
ganization of the schools, as I have already intimated, ro 
ttempt had ever been made to grade them. Another important 
tor in the situation was the attitude of the communities toward 
expert supervision. Three of the four towns in the district had 
lways opposed such supervision as long as it was optional and 
were not inclined to submit gracefully when according to the 
provisions of the new law it became compulsory. Such were the 
general conditions as revealed by my preliminary survey. 
However, there were three bright spots in the general darkness 
of the situation. First, the splendid new state school law which 
made the superintendent a state official with a pretty free hand 
and which provided liberal state aid for rural schools where it 
might be necessary to keep them up to the required minimum 
standards. Secondly, intelligent school boards willing to co- 
perate. And last, my own professional equipment which in- 
cluded a pretty thorough training in educational measurements 
and an earlier experience in the teaching of rural schools. Accord- 
ingly, I tackled the proposition determined to show what scien- 
tific method in education could do for rural schools if it had the 
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ANALYZING THE SITUATION 


The following week was spent in analyzing the conditions { 
to exist and in deciding upon the most efficient way to bring 


h \s a result of this analysis a number of 


out ol chaos 


problems seemed to stand out clearly demanding early att 


From among these probl ms I shall select, for present dis 


only those, in the solution of which as it seemed to me 


ized tests and scales could be used to good advantage. 


Problem 1.—To grade the schools fairly and accurately 
the schools graded in order to start the pupils right for 
vear’s work was of course the most urgent problem. | 


have been a comparatively simple matter to grade them 
ilv on the basis of the teachers’ judgments. But there are 


objections to this method even as a beginning, especially wh« 


teacher is new to the school. If, for example, children ar 


in grades lower than their parents think they ought to be, tl 


bound to be some strenuous objections from some of these par 
and the only evidence one has to offer is that the teacher tl 

the children ought to be placed in those grades. Did you n 
hear this line of talk from an irate parent? “My John is ju 
smart as Mrs. Smith’s Henry and he ought to be in the same 


or 
I just won’t stand it!” 
It is not by any means easy in such cases to prove to 


1 


her judgment. And the fact is that she did not have a 


basis. 
should exhibit in order to belong in a certain grade? What st 
ards of achievement did she have for the different grades b: 
her own arbitrary judgment? 

Giving ordinary tests for grading purposes is also inaccurat 


tendent and hence represent merely their judgment as to 


grade. 


being at a loss as to just what they are expected to achieve. 


satisfaction of the parent that the teacher has a sound basis 


tbove. It’s a plain case of showing partiality so there nov 


How did she know just what knowledge or ability a chi 


unfair, because such tests are devised by the teacher or super: 


they think a child ought to know in order to be placed in a certain 


Worse than all else, the children themselves are apt to bec 
discouraged, not understanding wherein they have failed, a1 
E\ 


the superintendent and teachers, if they are conscientious, 
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atisfied because they cannot feel sure that injustice has not 


aah Retarding a child without good reason, thus robbing 
i] year of his time, is a serious matter, at least for the child. 
What method of grading then could be found which would 

‘air to all concerned? After casting abou for some time 
solution to this problem, it suddenly occurred to me that 
lardized tests would help me out of my difficulty. Did 
not offer definite standards of achievement for eac h grade 
those standards were not based on unattainable 100 percent 


ction nor upon the opinions of dogmatic educators as to what 
ild ought to know at the end of a certain grade. They were 

imentally derived and based upon the amount of work t 
grades 


| children are actually doing in the different 
e whole country and not upon the amount of work somebod: 


Vv 


ks they ought to do. 
giving these tests in all my schools I could determine just 


the educational ladder. ‘The proc 


ere each child belonged on 
,uld be roughly comparable to measuring a large number ot 


ks of various lengths by means of a tape measure sorting them 
ight piles, each pile containing sticks of about the same 


sth. Then when angry parents wanted to know why their 
ren were graded so low, I could show them. 
ssclves could be made to see wherein they had fallen below 
to do to come up to the 


The children 


1 and what they would have 
Both superintendent and teachers would feel that 
Surely I needed standardized tests 


undard 
ndard. 
hey were on solid ground. 


the first thing. 
Having reached this conclusion, I immediately ordered all the 


sts and scales I knew of that were sufficiently well standardized 
for my purpose. They covered the following subjects: arith- 
metic, silent and oral reading, spelling, writing, geography, history 


+ 


and English language.’ 
Problem 2.—How to measure the progress of pupils—Having 


ttled upon how to do the preliminary grading, the next problem 
For who do not know standardized test nd want 
mmend for a beginning the purchase of Measu 
nd Educational 7 ind Measuremen 
lescribe the best tests and their uses 
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was to find a just method of measuring the progress of pupi 
promotion purposes. The same objections to teachers’ t 
good here as were noted in discussing the previous pro! 

This problem involved, obviously, the finding of a sati 
system of marking. It has been proved beyond dou 
ordinary teachers’ marks are unfair, inaccurate, and gi 
unsatisfactory as a means of measuring progress or as a | 
promotion. 

In measuring the progress of pupils, standardized test 
surely find their widest field of usefulness. Here the pro: 
be compared to standing a ten-foot measuring rod beside a } 
tree when it is a foot high and noting its growth in height. W 
it has added another twelve inches it belongs in the two-fo 
Twelve inches more and it is promoted to the three-foot cl 
soon. It is even possible to devise a satisfactory system of 1 
ing, for report card purposes, with the aid of such tests, as 
explained later on. 

Some of the teachers thought that the new state progr 
studies for elementary schools would be sufficient guide f 
motion purposes. This program is thoroughly practical ar 
to-date. But it offers no definite, objective standards of a 
ment from grade to grade. Therefore it is not a satisfactory 
with which to measure the progress of pupils and to dete! 
when they are ready for promotion. It is true that a pri 
program of studies specifies the subject-matter to be cover 
each grade but it is left entirely to the judgment of the t 
as to when that subject-matter is covered satisfactorily 
ground may be gone over more or less thoroughly and with 
unequal results according to the methods and arbitrary sta1 


of the individual teacher. Hence, it is obvious that programs 


study cannot take the place of standardized tests that a 


fairly objective. 


e 


Problem 3.—How to measure the ability of teachers —One 0! 


‘ 


greatest needs of superintendents is a method of measuring 


ability of teachers that will be accurate and fair to all concer 


A method that will not leave the superintendent open to 


charge of favoritism or poor judgment. A method tha 
satisfy a teacher who has been rated something less 


“excellent” that her shortcomings are real and not hallucinat 
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e mind of the superintendent due to his personal dislikes and 


1aices. 
at is wanted is concrete evidence of a teacher’s ability or 
of ability that will allay carping criticism from whatever 
ce. It is decidedly neither accurate nor fair to estimate a 
her’s ability ~ lely by observation made by the superintend- 
} 


luring his visits to the classroom. It is not fair because (a) 


observations do not furnish a sound basis for judgment, (b 
superintendent’s opinions are quite apt to be colored by 
onal prejudices toward an individual teacher or her methods, 
lasses often show at their worst in the presence of visitors, (d) 
n the teacher may fail to do herself justice under the critical 
of the superintendent. It is inaccurate for all the reasons 
| above and because (a) some teachers do excellent work when 
superintendent is present and shirk all the rest of the time, 
b) if such teachers do their own testing, even the results may 
made falsely to appear satisfactory. 
Provided a teacher is of good moral character with high ideals 


| a fairly pleasant personality, her further desirability as a 


her is measured by the results she gets as determined by the 
gress of the pupils when such progress is objectively measured 
r all, it is results we are after, primarily. Hence, the stand 
ized tests measure objectively both the progress of the pupils 
nd the ability of the teacher at one and the same time. 
Problem 4.—To find a practical method of supervising study ind 
eaching how to study —This may seem like a large contract for 
. one-teacher rural school with its crowded curriculum, but I 
shall try to show that it can be successfully worked out by using 
proper methods of study supplemented by judicious use of the 
tandardized educational tests and measurements. 
This paper merely presents some of the problems confronting 
e in my new work together with some plans for their solution and 
reasons therefor. Following articles will describe in detail the 
working out of these plans and the results achieved. 


; i - 
397 
| 
| 
| 
| 
d 
| 
| 
] 
= 
x 


COEFFICIENTS OF REGRESSION 


LEONARD P. AYRES 


Russell Sage Foundation 


In the March and April numbers of the JouRNAL oF Epvucationa, 
RESEARCH there were published articles by the writer on shorter 
methods for computing the coefficient of correlation. The object 
of the present article is to describe a short method for computing 
the coefficients of regression and to comment briefly on the pra 
tical utility of that measure of relationship. 

The coefficient of regression is a measure which tells how m 


change takes place in one of two series of paired values for « 
change of one unit in the other series. Suppose we have a set 
figures giving the ages and grades of the children in a sc! 
system. Since the plan of the system is that children shall | 
promoted one grade each year, it is sure that there will be a hig! 


correlation between the two series. 

We know, however, thai in nearly all school systems many 
children fail to go forward at the rate of a grade each year and t] 
the average progress is in marked degree less than the ideal. Th 
coefficient of regression is the measure which will tell us what t! 
average rate of progress is. It will tell what the change is in 
grades for each change in years or what part of a grade the averag 
child tends to advance for each additional year of age. This is 
what is meant in this particular case by the statement that t! 
coefficient of regression shows the change in one series for a unit 


of change in the other. 

The formula for the coefficient of regression, as it has ordinarily 
been stated, is not easy to use or understand, but its difficulties 
are mostly easy to avoid. Its use will be illustrated by finding 
it for two correlations, one for a short list of paired values and the 
other for a table of distribution. The formula for finding the 
coefficient of correlation is the one explained by the writer in the 
two previous articles published in this magazine. It is as follows: 
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Sum of prod icts of sult ject 


minus 


av x total of these items av. 


Let us apply this formula to a short list of paired values repre- 
nting the ages and grades of ten school children. Two of them 
van school four years ago, two three years ago, two two years 
_two last year, and two this year. They all entered at the age 
ix. One of each pair went forward one grade ea h year while 
other spent two years in each grade. Their ages and grades, 
sether with the computation of the coefficient of correlation, 
are shown in the following tabulation: 
Ages 
(Rel 


1 
1 
1 
2 
2 


Total 

Average 
24= 
24= 
$.0=640 


207 —192=15 
74—57.6=17.4 
660 — 640 = 20 
15 
r=- = - 2 = ().80 
V174 X20 V 348 18.65 
In this example the coefficient of correlation is equal to the 
fraction —__—_———-. The numerator (15) 1s derived from the 
V17.4X20 
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relative items 
av. of subject items X tot. of relative items ! 
Sum of squares of sub. items Sum of squares rel. items 
X total of these items 
VAT 
+ Ol 
6 36 6 
6 | 
6 1 36 
ig! 7 1 49 j 
7 49 14 
4 64 16 | 
2 4 81 18 
hat 3 8 9 64 24 
3 10 9 100 30 
the 4 9 16 Q] 36 
: 5 10 25 100 50 
660 207 
‘ | 
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| 
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tne | 
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products of the items of the two series. The denominator is 


to the square root of the product of two numbers, wl 


ind 20. The first of these two numbers is derived from 


fect series. giving the data for grades, and the second fr 


relative series, giving the data for ages. 


lhe coefficients of regression are derived from this fractio 


are——— and —. The first has as its denominator the nu 


17.4 20 


17.4. which was derived from the data as to grades. T 


efficient of regression | — tells the amount of change in 
17.4 
taking place on the average in this group for a change of on 
grades. This information does not in this particular case giv: ' 


information of much value. 


The other coefficient of regression is the fraction 


which the denominator was derived from the data on ages 
coefficient tells us how much the children in this group go forw 


in the grades on the average for each advancing year of age. It 


tells us that they go forward or —— of a grade for each \ 
: 


of age. This is in accord with the Ofiginal conditions of the pr 
lem. for it was stated that half the children made 100 perce 
normal progress and the other half 50 percent, or an averag 


75 percent of the full rate. 

This is information of an important type that cannot be se: 
by the simpler processes of working directly with the averag 
the series and trying to compute the relationship between 
time the children have been in school and the progress they | 


mace. 
coeflicients of regression can be used to great advantage. 

The method described for finding these coefficients is far sim] 
than the one usually used. The formula commonly given 


In many sorts of results from tests of classroom work t 


standing for the coefficient of regression) is p=r=- 


The steps by which the method here described was derived f1 
the standard formula may be readily followed through by any 
familiar with the ordinary notations for the coefficient of cor! 


tion. They are as follows: 
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[he application of the method described may be again illus- 
trated by using as an example an age and grade table. The ore 
sen is a supposititious distribution for a system where 160 
children enter each year at the age of six. They are promoted 
ially at a 75 percent rate and none drop out. The data for 
table, together with the computations of the coefficients 
of correlation and regression, are shown in the accompanying 
bulation. 


160) 40) 
120] 60) 23) 

90| 67) 34 
67 

1 


| 
| 


950 


51| 2 
38) 56) 858 
2 | 546 
176 
— | 
| 


160 160) 160! 160 160) 160) 1,2 642 21,446 


| | iv. of sub. items 
4,642 


— = 3627 
1,280 


RT 960/1,120) 1,2 80) 1.440) 1,600) 1,760) 1,920) 2,080) 12,160 
10, 240}12,960) 16,000) 19, 360) 23,040) 27,040) 122,240 


Zi 160) 280 400 521 641 760 880) 1,000 iv. of rel. items 


R(ESf)} 960}1,960) 3,200) 4,689] 6,410) 8,360/10,560)13,000) 49,139 12. 160 _ 
| | 
| 
1,280 


1920 401 
p=r_—, or 
4 
=, or 
n — 
n " n 
pac 
z= ¥ 
| 
' 
S R—AGES 
Grades} 6 | 7 8 | 9 | 10 | 11 12 13 I | ST SST 
2 | 2| | | 213] 426 852 
; 1,926 
‘ 3,328 
5 Ol 5 4,750 | 
t] ¢ 5,148 
| | 1,408 
I 166} 160) 
rh | | 
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$4,099 

16.836 

Vv 46) 6.720 30.979.200 

In this case the coc ficient of correlation is 0.91. Su 

. 

2 efficients based on age and grade tables are always high and 1 
is is surprisingly small range between those for relatively el 


school systems, having little retardation and those for fa 


effective systems showing high percentages of retardation. 


Che coefficients of regression are of greater interest and 
value. In this case the coefficient of regression based on the gr 
is 1.09. This indicates that in this school system the child 
tend to average 1.09 increase in years of age for each advance 


one grade. 
The other coefficient in this case gives us more valuable ini 


mation. It is 0.75 and is based on the ages. It teils us that 
children in this system tend to go forward on the average U 
fourths of a grade for each advance of one year in age. This i 
agreement with the conditions laid down at the outset which wer 
that these children were regularly promoted at a 75 percent 
Coefficients of regression can be made to yield informatio 


great practical value. They may well be used in studying su 
questions as: regularity of attendance and promotion rates, d 
ciency in weight and hemoglobin counts, progress through 
grades and expenditures for supervision, pages of material r 

in the first three grades and ability in silent reading, time sp 
on spelling drills and scores in spelling ability, years of schooling 


Ty) 


and earnings up to the age of fifty, and many others of the m 


varied character. 


402 
| 
{ 

a 

a 

€ 

+ 
a 

a 

4 
L 
a 

a 


Editorials 


REVISING THE COURSE OF STUDY 


In the voluminous discussion of the reconstruction of the cur- 
riculum during the past year nothing is said about the cost. It is 
sumed that if the superintendent and teachers decide upon a 


revision, the staff will perform the task in their leisure t'me. But 
such an assumption is entirely erroneous. A new course of study 
can be prepared by the staff but a thorough-going revision involves | 
too much detail work of a clerical, time-consuming sort for any 

stall to be able to perform it in their free time. ‘To discover the 


language curriculum requires anywhere from two hundred to five 
hundred hours of clerical work, which is the full time of one person 
for at least a month of eight-hour days; and this does not include 
the time of the supervisor of the study who formulates the plans ' 
and writes the report. To discover what mathematics is needed 
as a preparation for the study of one textbook in chemistry involves 
fifty hours of clerical work in addition to forty hours devoted to the ! 
study by the supervisor. To collect practical problems and proj- 
ects to supplement the teaching of physiology and hygiene, 
arrange the necessary material, and prepare it for classroom use 
involves the expenditure of fifty hours each for three persons. And 
all of these are fragmentary studies. | 
It is quite as reasonable to expect the manual arts department | 
to build the school buildings without assistance as to expect the 
staff to revise the course of study in their free time. Bricks can- 
not be handled as rapidly as ideas but there are more ideas in the 
course of study than bricks in a building and it takes time to han- 
dle ideas. The task of the revision of what children are taught is 
immeasurably more important than the construction of buildings 
and the difficulties are much more complex and quite as time- 
consuming if the work is thoroughly done. 
It is, therefore, necessary for boards of education who authorize 
a revision of the course of study to provide funds to make it 
403 
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possible for certain teachers to be relieved of part of their 
to engage clerical assistance, to employ experts on t 
phases of the problem, and to make the necessary stu 
research department. It is becoming increasingly nec 
state departments, the federal bureau of education, ar 
large educational units to establish the curriculum as on 
major projects of investigation with a staff sufficiently 
make revision more than a makeshift. The deadweight 
load is much greater than administrators have generally 


SCIENTIFIC CURRICULUM BUILDING 


a The work cannot be done by discussion and argument. D 

9 studies are necessary and details cost money. 

W. W. | 


Scientific curriculum building involves a danger of w! 
curriculum makers do not appear to be aware. The met 


frequently practised consists in finding out what element 
school subjects are in frequent use and incorporating th: 
elements into the subject matter to be taught. Analysis rev: 
example, that adults make almost no use of fractions or deci: 


that periodicals and newspapers contain surprisingly few hi 
cal or geographic allusions; and that the fundamental vox 
of business and personal correspondence is astonishingly sm 


Sometimes the analyst reaches the conclusion, express 
tacit, that the curriculum should contain no more than thes 
ger elements which he has found to be in frequent use. M 
often, however, it is those who use his results who reac] 
conclusion. This, we maintain, is not a correct inference. 
only correct inference—and it is the inference of the more car 
workers—is that, no matter what else is included, the elen 
thus found to be socially useful shall certainly form part of 
curriculum; in other words, that they shall constitute a part oi 
“minimum essentials’’ of the subject to which they belong. 

The bearing of analyses of social needs upon the curriculum m 
be most completely illustrated with reference to spelling. 11 
is true not only because the social value of spelling is obvious but 
also because more analyses have been made of spelling usage t! 
of any other. The principles, however, which we shall sugg 
have a general application to all the subjects which have been 
similarly studied. 
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the first place, we cannot by any means be sure that the 
determination of frequency of use is the true one. For 
in the list which purports to consist of the thousand 


nest words, we do not find the names of our daily meals 
breakfast nor lunch, dinner nor supper. Nor do we find 


mmonest articles of tableware, such as Plate, 
nd spoon. Many articles of food potatoe a 
meal, fish, bread, and butter—are not named; nor are some of 
ommonest articles of clothing nor some of the most familiar 
Only the horse is mentioned among domestic animals. 
log and the cat, the cow and the sheep find no place in the 


One may contend that these may indeed be common words 
ut being frequently used in written discourse. The conten- 
however, has little plausibility. A child cannot write of his 
without using such words as hide, jump, swim, fish, or sled, 
these words are omitted from the thousand most frequently 

He can scarcely write of the barnyard without requiring 
omitted words as hen and egg; he cannot write about his 
rden nor the baby at home; nor about the moon, the sun, the sky 
the stars. Yet these are the things within his experience. 
rhey are, therefore, the sort of topics which we should expect him 
write about. 
On the other hand, among the “thousand commonest words” 
found these: preliminary, recommend, impossible, assure, com- 
investigate, national; and a number of terms of apparently 
meaning such as property, judgment, testimony, complaint, 
reement, witness, and conviction. This suggests that the source 
ur vocabulary studies must be very greatly widened and that 
enormously greater amount of written material must be 
xamined. 

In the second place, even if true frequency of use has been 

termined, we assert that there are other tests of value than 

quency of use. For example, although the word bread may be 
htly excluded from the thousand commonest words; yet cir- 
stances which, while they may be relatively infrequent are 
vertheless inevitable, will certainly make it at times indispen- 
ble in one’s written vocabulary. Future research may con- 
ceivably confirm the present determination that apple and banana, 
right and beautiful, meat and drink, likewise do not belong to the 
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thousand commonest words. 


they should be banished from our spelling curriculum 


are simple words and they stand for ideas common to the r 
The ideas may not require expression quite often enough to s 
for the words a place among those used with an assigned frequ 
but when these ideas do require expression—and no one can « 
the necessity for such expression—they become as “‘s 
useful’ as do their more frequently used competitors. 

In the third place, in selecting material for the school c 
lum, difficulty as well as frequency of use is a criterion. In 
to a certain extent there is an inverse relationship between 
culty and frequency of use. Some elements of school subj 
precisely because they are frequently used, and hence often 
peated, do not need to be taught at all. Such is the case, 
example, with most of the two and three letter words in 


language. No one who is in the least degree literate misspells and 


except by inadvertency—and correcting inadvertency is not 
spelling problem. Some of the recent spellers in their attempt 
adhere to the vocabulary studies have included a consider: 
group of words which do not constitute a spelling problem 

In the fourth place, whether with reference to spelling or 


other subject of the curriculum, whatever the much-discuss 
aim of education may be it contemplates something more than t! 


round of common experiences, something richer than the elen 


tal facts of life. ‘A man’s reach should exceed his grasp”; and 


is only by providing for more than is now generally availabl 
progress is possible. Here as elsewhere in the application 
scientific procedure to education, a sound philosophy—as we 


a sound common sense—must be invoked to save the scienti 


procedure from itself. 


Four points may, therefore, be made with reference to the suf 


ciency of the idea of frequency of use. The first is that mat 
far greater in amount and variety will have to be examined bef 


we can be sure that frequency of use has been determined. The 
second is that certain material of relatively low frequency 0! 


occurrence has a social usefulness which renders it indispensal 
The third is that difficulty, or need of being taught, is an impor! 
criterion—one which operates in particular to reject from 


formal curriculum an appreciable amount of frequently used 
The fourth is that if we include in our curriculum on!; 


material. 


But this is not a sufficient reason why 
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materials which are found to be frequently used by children 


lults we leave altogether out of account the material which 
ht to use and would use if their lives were fuller and 
rhis fullness and richness, we feel quite sure, the school 
envisage. Moreover, to adjust the curriculum merely to 
is to doom our educational system to a static con 


age 


wherein progress becomes impossible. 
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stron Commission. Virginia public schools Including the report 


Richmond, Va.: Everett Waddey Co., 1919. 400 pp 
t a certain 


¢ in surveys whose object is merely 


is this report. Its precision of aim gives 1 


culiar in other respec 


is not among the 


in entire al 


- of the report, an abstra would be too extensi 
published shortly by a commercial hi 


to recomn 


bility of the report 


mprovement, namely, that the reading ma 
should be conscious of no | 

lirectly require the reader to consul 

b. and the re ferences to tabl 2S. like bibli 


in footnotes. 
legal status of schools in Virginia is peculiar in that the constitution, in 
f to general provisions, embod Accordingly, many 


mmendations requir 
osed by the 1918 a 


They must then be 
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; \ yusinesslike 
int which is often lacking! co find out some 
3 Moreover, the survey is pits. In the first place, it is a 
<urvey and, while the system HEE: largest, it is by no means sm ll ' 
nd place, considering the bigness of the undertaking and the wide range of 
1 the survey report is brief—brief in a day when brevity of reporting 
' means common. In the third place, being a state report, its findings wi rk 
: - inevitably into recommended legislation, i.e., into provisions for speciic Improve- 
- In the fourth place, there is AEEEEEEsenc of either animus or the effort 
n cet mebody 
1 3 Despite the brevit ve. More- 
t ok, we are and will 
therefore. be easily available. We feel inclined strongly Smnend It to tudents, 
ld we be greatly surprised if professors of educ tion should find parts of it ; : 
as lly the financial parts—useful as required reading 
As an example of a good method in reporting, it seems to us that the book is 
tinctive. The main body of tabular material is thrown into the | k of the volume; i 
: i ld be complete in itself; in 
= 
ie ther of essential detail. Thus, 
te tables. It should form a 
The rraphical citations, should 
= nhl 
f the survey r istit nal ar nent ec 
. ndments were } sembly: others will have to come up for the 
sed t time this year. [EB passed again in 1922 and submitted to the 
nly people. 
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tions of the commission to the Gener 


speci l relief fund: of the remainder, one-third to be distributed on average or 
attendance, one-third on the number of teachers employed, and one-third ’ 


the adequacy of the local support; (5) that an effective compulsory edu 


1 school term of nine months be provided; (6) that assessmerts be increased 


ized and the constitutional tax limit removed, the limit to be determined by t! 


lature; (7) that free textbooks be provided at state expense; (8) that te 


e increased and based on minimum professional qualifications, the state 


1 from fourteen to twenty cents to provide 1 part of the necessar 


9) that. as to teacher-training, normal schools abolish high-school courses, tr 


elementary school teacher nd extend the professional course from two 
that training departments in high schools be abandoned; that state institutions 


learning be operated all the year round on the four-quarter basis, with special pr 


by means of two six-week terms in the summer for public school teachers; (1 


vocational education, physical training and school hygiene, education of negr 


thec onsolidation and improvement of rural schools be definitely organized. 


The survey has not failed to provide for adequate financial support for th 


echool svstem as it would be constituted if these recommendations were enact 
law. We should not know where to turn to find a clearer statement of how 


mine and provide the amount of money needed to operate a good scl ool systen 


The General Assembly of 1918 had appropriated $10,000 for the survey comr 


it 


sion. Later it seemed advisable to create a division of tests and measurement 


was evident, however, that, in order to do anything at all adequate in ay ply 


tional and psychological tests throughout the state, a great deal more mone; 


be needed than the survey had in hand. Fortunately, the General Edu 


was induced to appropriate $12,500 for this purpose. 


Accordingly, for the first time in a state survey an attempt was made to 


the character of the work of the schools by means of actual standardized tests 
lhe chapter devoted to the work of this division is entitled: “The Res 


It is wholly inadequate; and the propriety of including 


Instruction Measured 


the survey volume is doubtful, especially since a special report on this ph 


survey work is promised for later publication. We observe the rather cur 

to say crotchety, selection of tests. This display of originality, however, led t 

one fortunate result, namely, the inclusion of two intelligence tests in the | t 
s the first large use in a survey of such tests. The results of these tests, if, in t t 
coming publi ition, they are prope rly related to the educational tests, will « 


an important improvement upon conventional methods of reporting 
» work of the Division of Tests and Measurements ! 
integral part of the survey which the Assé mbly had in mind when i 


» problem was distinctly a legislative one. What Virginia n 


cr 
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ing else is permission to go ahea 
es. The decision to test the sch 
y. but it seems to us to constitute an almost ent 


e rest of the re port, it 


nless we 


10,000 may well prove 


Herscuet T. Talent in drawing. (Si hool and H« 


Bloomington, Illinois: Public S¢ hool Publ 


nograph reports a study of gifted children 

the General Education Board and was cond 

r G. M. Whipple. In this study two grouy 
mized, namely (1) those pertain 


rtaining to pupils of special ability. 


r up Of | 
ise of tests to disco spec ial ability 


‘roblems. Its scope is indicate 


those who “by endowment or by training are juipped as to 


nd to su ceed extraordinarly well with, some on ibility 


resent study proposes to consider a special ability (drawing with reference 
yblems: 


are the essential psychophysical characteristics of persons possessing 


w may the test method be used in the diagnosis of such talent? 
fve individual tests, mental and physical, which were more or 
were used with nineteen subjects chosen for re« ognized talent in draw 
vere distributed as follows college or university, 5: s ond 
tary school, 6. siogr iphical and pe rsonal data were also « 
means of the “psychograph”’ 


ilts are prest nted by 


performances of each subject in sev ral tests 


ces. This method of representing the statisti al « 
1 tests is especially useful for liagnostic purposes 
} 


to the first problem the characteristics of thos 


bilities seem closely related to ability in drawing 


| to reproduce it: to observe; to select from a complex visual ion the most 


ntative and the most beautiful aspects; to remember visua forms; to mar 


em mentally; to control hand movements in accordance 
to invent—i.e., to bring together into new art sti 

rent visual experiences; to judgé the beautif 

nd to discriminate differences in color and in visu 

in the act and products of drawing, and gener ] 
teristics of those talented in drawing 
second problem—the diagnosis of talent in drawi 

foregoing abilities are the ones selected from the entire 
st diagnostic value. These are described and references 
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uy U ed by Thorndit 


Each unit “represents that amount of merit 


a where they may be found. It is recommended that tests be arranged t 
R not the strength n hilit but Iso it mprova lity I 
me nv d ties not primarily related to drawi! 
ioe to the t effective educational and vocational u f measurement « 
it ant thy the author in tl tudy to pr 
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++) determining the particular talent 
J OrIN | 
Murpocu, KATHARIN The of ceriain elemen rand sewry 
ers College Contributions to Education, No. 103 New York: 7 
i Columbia University, 1919. 120 pp 
= rhe scope of this monograph is well described by the following stateme 
aAULDOT 
+ “The st c tasks of this research are as follow ; 
R 1. To make a scale by means of which merit in certain forms of har : ; 
may be measured 
: 2. To make an inventory and analysis of the faults found in t 
| sewing 
3. To determine the relative importance of of \ 
tn tors of general merit in sewing 
4. To determine the relative reliability of judgments concerning various 
faults na n ing \ rious tcnes 
5 determin t reliability of one or more s mple of a cl 
in evaluating her real ability in that kind of sewing; to determine (b) t 
af of would be required in order to 
degr of probability that a child’s real ability to execute that particular 
n 
was meaeu 
f "RB letermine the relative accuracy of competent persons, wit var 
' degr f knowledge about sewing and the teaching of sewing, as Judges ol Z 
7 produ ts 
7. To test the value of our sewing scale as a means of attaining greater 
4 
. titude in the grading o ving products ‘ 
As a preliminary step in constructing the scale for measuring certain eler ; 
hand sewing, sa les of the hand sewing of 1,212 individuals were secure 
4 sampl ré lled samplers. They were uniform as to material and kinds ot 
In quality t ranged from the mplers contributed by 37 children v 
a s 1 classes for defectives or in institutions for the feeble-minded 1 
contributed | lults wl BE: expert hand sewers. From tl 
of which, on the basis of the 
of method of selectior 
ry 
d 
4 
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between the samplers when one is recogr 
75 per cent of competent judg 
” “Zero was arl 
h could be recognized 
sampler, but which had abs 


On the basis of this definition of 


ges conside red 
ited by an imbecile boy “untrained 
ntrol and who suffers from serious ¢} 
h of the s umplers contains five kinds of stit 
hemming, and backstitch. Haif-tone reprod 
mplers chosen for the final scale. Three vie 
iy that all of the sewing is represent Thu 
ral use consists of half-tone reproductions of the 
it all of the sewing is clearly shown. 
construction of the scale was supplemente 
hes involved in these samples of hand 
ed to 23 in number and the relation of these to | 
nplements the scale in a very significant way. It is parti 
ting in the interpretation of measures in terms of the pupil ne 
In the study of the reliability of the measures yield 
nt findings. When it was used to m 
leted articles such as aprons and bags, it was 
Terent judges were less variable than when isol 
r to those of which the scale was m 
feasible to use the scale in measuring the h 
second finding was that judgments of diff 
were found to be less vari ible 


hout the scale, although only 


n this experiment and were untrained in the 
he most significant features of Miss Murdoch’ 
pplemented the usual scale derivation. The 


not already arrived, when new measuring instrun 
tion until scientific evidence concerning their 

ly it is being urged by some that each measu 

1 by a definite statement concerning its reliability 

» of the first, if not the first, to accompany the 

vith a statement of the reliability of the scores that 
hermore, as stated above she demonstrates that the 
n judging the hand sewing on completed arti 

The scale has yet to be standardized and there is not cor 
ient directions to guide a teacher in using it 

le itself available to teachers, detailed directions for using 1 
ts for the tabulating of the results will be provided 
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ton. Illinois: Public School Publishing Co., 1920. 125 pp 

For a long time there has been in this country some recognition of th 
of meeting the needs of pupils of marked ability in such a way as to give t 
tunity for re rapid advancement than that of the average pupil. T1 
hitherto unsuspected individual differences revealed by the recent widespr 
tion of mental and educational tests are fast pushing this subject to the for 


for the Study of Educat 


rtant and timely contribution to the science of edu 


more made a! 1 ti 
study the report of the results of an experiment in which pupils sel 
hasis of their excellence in school work were placed under special instru 
includes a summary of the various schemes for flexible promotion wl 
tried out in t ountry, and a description of the t pes of special class 

! tablished for ed pupi! In addition, there is a chapter on the m 


to the instru 


ittempt 


ym 1 


naining fifth- and s <th-grade pupils of the 


throughout experiment as a control group. The intelligence quo 
member | school as measured by the Terman revision of the B 
EGaole wat from 99.3 to 146.6 It apr rs. therefore, that on the bas 
tests there were pupils in the special class who did not belong there. Inde 


vuthor’s re 
for admission to such special cl 
il class. Notwithstanding this handicap the spec ial class was 


ommendation were adopted that a minimal I. Q. of 115 be 
isses, it would rule out fourteen of the thirt 


of this speci 
the work of two grades in one year, and seventeen puj ils secured correspor 


motion at the end of the school year on the basis of the regular examinations 


all of the remaining pupils passed special examinations after review work dur 
summer and thus secured promotion. Educational tests given throughout 
showed that by May first the pupils had actually g 1ined a year as measured | 
scale 


The interpretation of the results of such an experiment is necessarily s« 


There is no way of determining to what extent the more rapid pr 


difficult 


these pupils is due to the special conditions under which they were placed ra 


to their superior abilities. As the author points out, practically all the 
truction of the specially gifted are equally applicable in the t 


‘1. It is difficult to say how much more rapid the advan 


adapted to the ins 


of the average pt 


of the control group might have been if it had had the advantage of the samé 


lly if the same spur to ambition had been provided. Th 


attention, and esp 


of a large number of pupils of only average intelligence in gaining promotion 
show that these factors were more important than the author believes. 


Epwarp H. Came 


412 
Henry, Trropore S. Classroom problems in the education of gifted children Nine 
‘ £4} National for th Study of Ed tion Bl 
4 
attention. 
In this monograph the National Society ion 
\ 
} | CUO! this class ol children, a 
teaching which are especially n of this cl 
a , bibliography covering the general field. 
I number of pupil lected for the experiment which was carried out 
: of the pul schools of Urbana, Illinois, was thirty—fhiteen trot fth a 
from the xth grade. lhe made to carry out t experin t 
verage conditions of schoolrocmminstruction. “Supervision, course of stud) 
; equipment of room ind of struction oO! t could | 
| 
1 
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News Items and 


This department will contain news items regarding research workers 


and their activities. It will also serve as a clearing house for more forma] 
communications on similar topics, preferably of not more than five hundred 
words. These communications will be printed over the signatures of . 
authors. Address all correspondence concerning this department to Walter 
S. Monroe, University of Illinois, Urbana, Illinois. 


One of the latest additions to the rapidly increasing gr 


West Virginia state educational institutions which have established a bur 
University Bureau of educational research is West Virginia University. In ar 

of Educational circular they announce the establishment of the bureau and 
Research the prices of a number of educational tests and the addresses from 


which they can be obtained. 


In 1917 Dr. Albert Shiels, then superintendent of schools, recommend , 
establishment of two new departments. Accordingly a Division of Educational | 
Department of search was established in charge of Mr. Robert H. Lan 
Psychology and 1s a principal of one of the elementary schools had attr 
Educational Re- attention. Also, a Division of Psychology was created 
search at Los Dr. A. H. Sutherland was invited to begin some st 
Angeles, California types of children. In 1920 Mr. Robert H. Lane was el 

to an assistant superintendency and thereby rewarded for 

meritorious service 

During the past two years comments have not been lacking that the work of t 


divisions overl ips. It was therefore decided to bring the two divisions together under 


the temporary name of the Department of Psychology and Educational R¢ 


with Dr. A. H. Sutherland as director. The new department is to continue th 


tions previously served by both divisions. It will have charge of the giving 


training teachers to give standardized educational tests and the collection and t 


tion of statistical information. It will also have charge of the segregation of types 


children and the direction of the special rooms for backward children. 


Mr. H. C. Daley, Survey Department, Highland Park, Michigan, sends 


following tabulation of the results of giving Monroe’s Standardized Silent R ng Mc] 

An Experiment Test in the seventh and eighth grades. Form 3 was given on Se; 

in Silent tember 19, 1919, and Form 2 on January 28, 1920. “After the ( 

Reading September testing pupils were reclassified into strong and weak al 
sections in accordance with the results of the tests. In several cases C 

capable pupils were transferred to a higher grade.” This shifting would tend to reduce ber 

the standing of the groups. In spite of this, all groups show remarkable gains. Ba 


This use of two different forms of this test raises the question of the equivalence 
of the forms. Although the different forms were constructed so that they would yield 
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mprehension scores, a recent study of the different forr 
nplished in all cases. However, the 
t Forms 2 and 3 are equivalent for com] 

They are not equivalent with respec 
ted to be fifteen to twenty words hi 
lence of the two forms used probably accounts for a portior 
‘oes not account for any of the gain in comprehension 


No. OF 
CHILDREN 


MBER OF PUPILS: 


130 words 


rate 75 words per 


omprehension of 


comprehension of 


he twenty-eighth annual meeting of the American Psy hological As 


t Harvard University, December 29, 30, and 31, 1919 was atte nded by 
than 150 workers in psychology and alli 1 fields i 
American held with the American Anthropological Associ 
Psy chological ican Association of Clinical Psy¢ hologists and provisi ns were made 
Association for inspection of the Massachusetts State Scho | for Feeble-Minded, 
the Judge Baker Foundation, the Carnegie 
in Hospital, the Psychopathic Hospital and other local in 
pherd I. Franz, Government Hospital for the Insane, Li 
elected president of the Association for 1920; H. S. Langfeld, Harvard University, 
and W. V. Bingham, Carnegie Institute of Technology, were elected to the council 
Chicago was elected for the convention in December, 1920. Twenty-seven new mem- 
ere voted into the assoc iation and the deaths, during the year, of John Wall ce 
Edward Cowles, and August Hoch were reported 
A committee consisting of Bird T. Baldwin, University of lowa Chairman); 
V. F. Dearborn, Harvard University; L. S. Hollingworth, Teachers College; B. Rum, 


415 
if 
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at this time 
anal 
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3. Thus the 
: of the gain in a 
RAT} CoMPREHENSION 
— Sept. | Jan Sept Jan. Sept Jan | : 
p of nth 252 205 «| ~=—(102 118 21 27 
¥ > 
eau nth 170 136 103 134 22 28 i ¢ 
t htl 199 161 101 135 21 28 
; rh h 156 285 104 124 24 28 
Low | HicrSevents) Low | Hicu Eicatn 
™ Sept Jan. | Sept Jan. | Sept Jan. | Sept. | Jan 
t | 39 06 ? 79 3 93 29 95 
ted r minute | 22 12 2 
| | 
nd rate 
minute } ©) |} 14 | 29 ? Rie 4 16 16 
for ) | 35 | 76 | 27 | 33 42 68 48 115 ) 
Below | | 
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t | 4 | 1 29 _3 
la | 
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lhe Scott Co., Philadelphia; and Helen T. Wooley, Vocational Bureau, P 


yn of defective children should be 


al Conference held at Albany, N. Y., in May 1919. TI] 
listed above is now engaged in (1) determining the qualifications of 


t and in sugg ng meal f establishing and promoting an ad 

| curriculur 2 vestigating the methods of legal certification r 

e states: (3) compiling data on the legal aspects of clinical work—t] 
testimony of a psychologist in court, commitments, etc.; (4) dr 


whereby the American Psychological Association may issue certifi 


determining the qualifications for psycholog 


6 titles under general psychology, ex 


I hol gy 16 intel gence tests, educ itional nd clinical psychi le gy 21 
p hology 2, social and religious psychoke gv 3, and applied psyche logy 
nounced d lopment of the technic of trade testing, the thorough try 


tests by their use on more than a million and a half recruits, bringing uy 


( 1 of older notions of median mental levels of unselected as 
neurotic, foreign-born, colored and other individuals, the need of tests ot 
of general intelligence for diagnosis of psychoneurotics, vocational 
tardation in schools, the need of systematic training and classifi n 


the rapidly growing field of clinical psychology ind the use of indivi 


tests in diag and prognosis of ability in school functions, may br 


© numerous and so varied in content, that no 


nore than briefly to those which bear closely upon 


rt idress of the retiring president, Walter Dill Scott, Northwestern U: 


on the toy Changes in Some of Our Conceptions and Practises in Person: 


rvey of progress in educational theory and practice. Evolution along fis 


emphasized. (1) A history was given of changes in the concept of th 


nature of individual differences from the older belief that peoples wer 


much alike and that such differences as appeared were due to environment 


; na +} 
ul 


to the present belief that individuals differ enormously in all traits and 


differences are largely innate. ‘The greatest achievement of the association | 


the establishment of the fact of individual differences and its applications 


tion, politics, industry, and economics 


2) The importance of reasoning as a factor in adjustments has been 


by the consideration of instincts, emotions, and habits. The operation of 


trends as the spring of action and the sources of discontent in industrial 
lustrated by concrete cases. It is not the violation of the worker’s logical p1 


that brings unrest and discontent so much as thwartings of his pride, his desire 


yproval, of mastery, and his instinctive and emotional trends. 


3) Education in the schools or in the factory must take into account the un! 


forms of reaction to features of the environment and seek to so order the indi 


416 Vol. 1, No.5 
Cincinnati, Oh vere appointed to consider the legal and prol ional 
- lir ly logists The N.E.A. at its last meeting passed a resol 
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- environment that the desirable adjustments may be made 
| director in industry must be enlarged and | 
the approved experiences so that desirable |! 
chness of content or training of gene ral faculties will n 
Changes have taken place in the concept of man and 
victim of his environment, he is not the ma 


The two should evolve toget! lustr the man 


bduing or opposing it 


iw the man to fit the job 


iob are not opposed, nor does the conce | t of select 
idequately express the present poi! 


, square peg for a square hole—ad 


function of the personnel manager is t 
n.”’ The work m 
1 be set to the task most in harmony with his part ila 


should 


he “creat ol the WOrker In 
wants ol 


ist be arranged to satisfy the human wa! | 


There must be a correlated improvement of the worl 
The last point led to a survey of the evolution of vocation 
f superstition, guess, and in idental inclinati 


nce methods o 
statistical metl 


to mental, physical, and vocational tests 
of the worker has been double 
me 2.000 minds through changes in the mat rial world. In the 


great increases in productivity may be expec ted through the 


the last century the productivity 


+r to the work.” 


ACI 


Following are brief summaries of papers, presented in the various s¢ 


1 sions. whi 
be of interest to workers in education 
A most valuable and practical method of evaluating scho 
ental ability is the result of studies by Rudolf Pintn 
ntal test alone is not sufficient to diagnose a cI ild 
nment based on both age and grade norms are n« | Two surve) 
ental and one educational, were devised and applied to 1,500 cases 
“index” ranging from zero to one hund 


A high mental age with low 
agreement 


lues are converted into a so-called 
median indices serve as a measure for the school. 
tion, whereas a clos 

In the same way different 


» compared, 


ational index indicates deficiencies in instruc 
etween the two indices indicates efficiency in the school 
sses in the same school or different individuals in the same class 


ling one to correlate innate ability with possible attainment and to apply corres 


ve measures when the need appears 


E. A. Doll, Princeton University, pres nted « 
tests of a million and a half army recruits and other subjects be ring upon the me: 


sts ol 


obtained from intelligence 
lian 


unselected groups 


ntal age of adults, commonly assumed to be about 16 years for 


rhe Stanford-Binet median mental age equivalent of ruits is 13 years; of 


irmy rect 
ero and foreign-born recruits 10 years; of adult m le s i 13 years, the 
tual tests used in each case being the Army Alpha. Fi -d typical public 

1ined by Alpha show no increase 1n median scores by ag 
to 30 years. From t 


hool children exan 
the same being true of juvenile delinquents, ages 16 
lian mental age level of native white adult 


he 
the suggestion was made that the me 
approximately 13 years. No attempt was m ide to determine t 
ental growth, since, it was suggested, “e motional development, skill, acquis! 
ptitudes and the like probably continue to di velop indefinitely.” The upper age 
limit of feeblemindedness is not coincident with the lower mental age limit of nor- 


tion, 
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which the intelligence scales are concerned. Normal and even superior “‘ints g 
is very generally associated with grave judgment and conduct disorder. Int t 
scales measure essentially ability to deal with ideas, as distinct from ility ¢ 
with things or with people. Psychotic breakdowns are essentially failures t 
ment to the social environment Ihe speaker en ized the minor réle of 
: gence” (ideational capacity) in mental balance, urging a conception of educat g 
discipline of character rather than knowledge. | 
With a few changes, the Binet tests were successfully employed by S. P. H s 
Hol oke C 1 
Pressey group tests also gave high correlations with the Binet scor nd 
ted by te ] | 
care of in frequency tables, correlations, multiple regression, etc., can be d 
such models 
L. W. Webb, Northwestern University, found the Pearson coefficient 
tion between rate of reading (Monroe Standardized Silent Reading Ts ) 
‘a Army Alpha and Thurstone Tests A and B ranging from +0.47 to +0.59 
‘ hension of reading gave coefficients ranging from +0.48 to +0.69. Speed an 
; prehension of reading correlate +0.85. The speaker contended that these corr 
: tions show too large a dependence of the pencil and paper tests upon rapi 
; comprehension in reading 
L. L. Thurstone, Carnegie Institute of Technology, found the cycle-or 
form of intelligence test to be of great service in furnishing data for recomm 
, candidates for admission to engineering colleges, in advising committees on scholar 
, in cases of delinquent students, and in giving vocational counsel. S. S. Colvi 
Brown University, reported a correlation of +0.60 between success in the I 
: Intelligence Tests and the standing in college for the first two years. The Thornd 
2 tests, first used in 1919, proved to be of great prognostic value and showed a 
correlation with itself in repeated tests on the same subjects. 
.. D. Mitchell, Pelman Institute, defined clinical psychology as a “professional pr 
tice” as contrasted with the “science” of laboratory psychology. Clinical psycho! ' 
was again contrasted with “applied psychology” largely on grounds that the |! , 
field may have no relation to the individual. Clinical psychology is the practi I 
. determining mental states in order to prescribe kinds and methods of educatior 
detecting specific abilities and disabilities of vocational significance and the ma! U 


ulation of emotional development for desirable social reactions. Dr. Augusta F. 
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ner, Judge Baker Foundation, emphasizing the function o 


» f 


lividual diagnosis, gave illustrations of the fa 
betray significant variations in me ntal equipment 
ny specific abilities was urged. Florence Ma 
h mental age or I. Q 
f psyé hopathic conditions due to phili 
minus scores, and more precise measures of the individ 
ble clue to either congenital or acquired syphilis. The 
psychopat 


lifferentiates the psychopathic from the non- 


tal age may be. 
devised to measure such functions as persistence, con 
nd emotional control are being applied to junior high-school and 
Correlations of results from the 


Pressey of Indiana University 
pre sent 


| intelligence, health, and estimates of intelligence were 
Indiana University, urged group testing of ral intelligen: 

a means of studying the effect of sch ining upon t 
Data permitting comparisons of test find 

ional classes, whites and negroes, etc., Ws 


re State Normal School, believes that norm 


hours to use the Binet tests in classifying 
rroup tests, but much more is needed to enable 


nterpret the results. Daniel Starch, University of Wisco 
from 1,000 first-year pupils, that approximately equa 
th great differences in language ability. Correlations rang) 
10.28 between interest in college subjects and grades rect 
J. W. Bridges, Ohio State niversity. The cozrelation betw 
t’s estimate of his ability in the courses was higher +0.50 to 
rom data obtained in several extensive investigations cited by 
ers College, Columbia University, it appears that even experi 
treat an individual as a compound of separate qualitic 
try, technical skill, reliability, etc., and to assign a m 
ndence of the others. The correlations between 
ven, the ratings being apparently affected by a mar! 
: in general as rather good or rather inferior and to b 
; general attitude. It was suggested that observers shot 
ting, and that the ratings should be given on the eviden 
E. G. Boring, of Clark University, offered several « 
eptance of the distribution of mental traits according 


The form of the distribution depends, for one thing 
lopted. If the normal law, moreover is the law of cl 
variables for which the relationship is not sim; 


the same form of chat 


encent 
lume which varies roughly as its cube, cannot have 
If the distribution for height is normal, the di tribution for volume 


ibly be. 

W. T. Shepherd, Washington, D. C., in a study of 148 children, ag eigh 
thirteen years, emphasized the importance of the educat ional and social exper 
the influence of respected teachers or friends upon the development of religious idea 
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to four or five times mere chance. Moral reversal 


times chance whereas reversals of musical preferences as a resu 


opinion is about twice chance. 


The State Department of Education of ¢ 
A State-Wide recen tly decided to have given in all schools of 
Use of Educa-_ the following standardized tes 
tional Tests Courtis Standard Research Tests in Arithmet 
Gray’s Oral Reading Test, Gray’s Silent Readir 

Ayres Spelling Scale, Ayres Handwriting Scale, “Ge lit 

At the present time the University of Colorado at Bould 
Teachers College at Greeley, and the State Normal School at Gu: 


ysburg | 
LYSUUTR 


co-operating in conducting extension classes for Color: teacher | 
western district of the state this work is in charge of Mr. O. B. Stapl 
by Dr. H. T. Manuel and Miss Stella Yowell. Mr ale Writ 
“The County i fa have been asked to direct this 
testing program), and while they are struggling with it, those in 1 
are quite bn <a with the technique of the work, and many of th 
scarcely comprehend the significance Z it, some of them not so muct 
having heard before of a “Standard Test.”’ But this action of 
Department has given the work large sore itv, and Dr. Manuel and | 
cooper: ne g — the people in our territory, meeting them in groups 
etc., giving them such instruction, encouragement, etc., as we 


them ‘ twat over’ the of the State Department, althoug 

is being attempted in a \ crude manner, and I fear somew 

may not be very helpful tg atime. However, it is a start, and will 


lead to something definite later 
“In our course we are using Monroe’s Measuring the Results of Tea 


as a text, and for the most part giving to the teachers themselves m 
tests discussed in this book. When the teachers seem familiar wit g 
test and the use of it, we have them give it in their schools and then 
their results, discuss them, and ask them to apply whatever suggest 
together may derive from such procedure.”’ 

The state normal school at Gunnison has established a School Set 


Bureau which is serving the county superintendents and teachers of the 
by supplying them with the testing material. In doing so, this norm 


is following a practice which has been found exceedingly worth while in ot 


states. 
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ie The prevalent belief that our judgments in the fields of appreciatior 
4 
SS literature well as in morals ar ynsiderably influenced by the ntrar 
the r rit exnert nm th ic mnoarted hv exnerimental ‘ 
th rity ex] 1th Py | pe! n 
a college students by H. T. Moore of Dartmouth College Comparis« 

grouy eld results showing that the knowledge of contrary opinions of tl L 
: the majority produces reversals of individual opinions in matter of speec!} 
under majority infl 

2s a result of expert or 
ARTI 

a Teachers College, Columbia 
+ I 


| National Association of Directors of 
Educational Research 


(E. J. Asnpaucn, Secretar) and Editor) 


a gentleman who is gre itly interested in the problems of 


-ntured the suggestion that most of our bureaus of educa 


misnamed. He stated that he thought they should be named 
se. since the work which was being done was almost, if not 
counting nature rather th: 
he statement is true and if there is not a suggestion « ontall 


ne 


ler if t 
beneficial to the members of our organization. Let each 
jucational research mentally review his work during the past 


ler whether or not it has been rese irch or merely accounting 


1) reveal d? Have data been gathere 1, tab ilated, and pre sented 1% 


nalysis of the causal factors and the setting up of a definite ré 


at the work of bureaus of educ ational research is most vital. Wet 
ypportunities are practi ally limitless We believe, also, that the pr 

1 that the future of the movement for organized bureaus rests in the hand 
re now directing such work. A few cities have established such bureaus 


a 


ntinued them because the s« hool administration did not feel that the benefits 


vere sufficient to justify their continuance. At this stage of the development 


movement such failure is almost a calamity. Superintendents and teachers 


fail and the schools will continue The educational world is acc ustomed to such 


< But we must not fail. We must not only discover status but also must reveal 


ncies and causes. We must offer to the classroom teacher and the supervisory 


Gnite constructive help in the solution of the problems which are reve iled 


‘rement. We must offer the administrators we ll-conceived programs based 


lefinite data which can Ibe presented to school boards and the j iblic We 


. the scientific attitude but speak in terms of common knowledge. We must 
nute problems and car¢ fully control conditions in our expe riments, but keep 
n mind that teachers and the public want results in terms of the larger educa 
nless bureaus of research can modify practice; unless they can offer constructive 
il along the line; unless they can make teachers, supervisors, and administrators 
:t their work is indispensable, they will fail. 
1t we shall not fail. 


he applications for membership of four persons are before the executive commit- 
Interest in the 


t this writing and others are going through the preliminary stage. 


work of the association is certainly growing. Does any member know of a bureau 
he will please write to the 


where which is not represented by membership? If so, 
secretary at once. 
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City, New York. 
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ANNOUNCING THE 1920 REVISION OF 
COURTIS STANDARD PRACTICE TESTS 
IN ARITHMETIC 


ctice or drill features of former editions are unchanged—the noteworthy 
is in amplifying the facilities tor testing and introducing several new 
ures for scientinc measuring and supervisory work 


Calu 


The pra 


nee 


covering the arithmetical operations with whole numbers in 


lesson cards, 

ies 4 to &, are unchanged. There have been added five research tests 

srovides scientific practice work and also the means of ascertaining the 
¢ rtaining t 

individual needs of the pupils, and the degree and kind of drill to meet thes« 
| t t wu 

The Teacher's Manual explains in detail ho detect and remedy indi- 

ual detects, so that the slower pupils may attal he grade of standard al ility 


and the brighter ones waste no time in useless drill. It also gives 
for giving the Research and Supervisory Tests. 


evice 


of their class, 


1] instructions 
who have been supplied with cabinet former editions can obtain the 
Revision supplying their teachers with a 

her's Manual of the 1920 Revision and sets ot Research Cards. Three pack 
ill ore’ the same quat tity of material for Research and 


added advantages of the 1920 
Tea 
ages of Research Cards w 
Supervisory Tests as does Cabmet | 

ice $7 50 net 


CABINET IL. Contains enough cards to supply 45 pupils 


CABINET II. Contains enough cards to supply 24 pupils; can be used in classes 
48 pupils by working the class in two sections. Price $5.25 
CABINET III. Contains enough cards to supply 12 pu ils 


ses of 24 pupils by working the class in two sections Price 


<TUDENT’S RECORD AND PRACTI( E PAD. Contains 16 pages o! 
r student’s records and 100 tissue sheets for practice work. Price 15 cent 

TEACHER’S MANUAL. Contains 64 pages 0! detailed instructions 

cents net. 

TEACHER’S RECORD. Contains pages 45 to 53 of Teacher’s Manual 

s cents net. 


LESSON CARDS 1 to 48: FORM A. 48 cards in an envelope. Price 50 cents net 
LESSON CARDS 1 to 48: FORM B. 48 cards in ar envelope. Price 50 cents net. 


S2.50 net 


EXTRA LESSON CARDS. Package of 25 of any lesson card. Price 50 cents 
net. 

RESEARCH CARDS. Package of 48 cards consisting of three Research and two 
Stpervisory Tests. Price 60 cents net 

SPECIMEN SET. Consists of 2 envelopes of Lesson Cards 1 to 48: Forms A 
and B: 1 Students’ Record and Practice Pad: and 1 Teacher's Manual. Price 


$1.25 postpaid. 


On account of unusual manufacturing and transportation conditions, it is advised 


that orders for next fall’s supply be placed now. 


WORLD BOOK COMPANY 


2126 Prairie Avenue 


CHICAGO 


Yonkers-on-Hudson 
NEW YORK 
313 South Preston Street 
DALLAS 
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The Summer Quarter 


Courses are equivalent in educational and credit value to those offered 
in other quarters of the year. 

The undergraduate colleges, the graduate schools and the professional schools 
provide courses in Arts, Literature, Science, Commerce and Administration, Edu- 
cation, Law, Divinity and Medicine. 

Ideal place for recreation as well as study. Golf, tennis, rowing, etc. Two great 
parks and Lake Michigan within walking distance. 


Students may register for either term or both. 


lst Term—June 21—July 28 
2nd Term—July 29—Sept. 3 


Write for complete announcement. 


The University of Chicago 


CHICAGO, ILLINOIS 


AMERICAN BOOK COMPANY 


EDUCATIONAL PUBLISHERS 


NEW YORK, 100 Washington Square 
CINCINNATI, 300 Pike Street 
CHICAGO, 330 East 22nd Street 
BOSTON, 63 Summer Street 
ATLANTA, 2 North Forsyth Street 


Address all communications to the nearest office of the company. Descriptive circulars, 
catalogues, and price lists will be mailed on request to any address. 


Your correspondence is solicited and will have prompt attention. 
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PRAIRIE AVENUT - - CHICAGO, ILLIN@IS 


Progressive teachers of geography striving to present geography 
through 

: the regional treatment 

.. and the problem method 


but handicapped because these features were ignored in current text- ; 
books, will be gratified to know that the ideal equipment is now , 


furnished in the 


FRYE-ATWOOD:NEW GEOGRAPHIES © 


The superb maps, the wonderful pictures, the after-the-war treat- | 
ment set a new pace for publishers of geography textbooks. 


Write us for:full information and ‘illustrative material. 


GINN.AND COMPANY 


COME TO BAT—THE BALL SEASON IS ON. 


When the JOURNAL OF EDUCATIONAL RESEARCH was announced 
last fail, six hundred subscribers optimistically paid in advance. , 


As optimistically we, the publishers, have made a journal required by and ° 
requiring six thousand subscribers. 

You, as readers, appreciate the accurate tables and charts and careful type 
setting of this Journal. Well, it- costs no\more to do this for six thousand than 
for six hundred.—You see the point—it costs as much for six hundred or two , 
thousand. We can do this grade of work at a subscription price of $3.00 if we 
have six thousand subscribers. If only two thousand are on our list next year, , 
the price must be four dollars. 


TRIPLE. THE SUBSCRIPTION LIST 


You who know and appreciate the Journal are its best advocates. You all 
have friends who will be glad to subscribe when you show them how really help- | 
ful the Journal is. 

Send us two new subscriptions at $3.00 each this week, thereby tripling the 
subscription list of the Journal and keeping the cost of your own next year's 
subscription at $3.00. 


All subscriptions should be sent to the 


Public School Publishing Company, 
Bloomington, [Illinois 
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Educating from the Social 
View Point 


THE HUMAN FACTOR IN EDUCATION 


By James Putrnney Muwnrog, Vice-Chairman Federal Board for Vocational 
Education ; Secretary of the Corporation, Massachusetts Institution of Tec})- 
nology. 

Education as a remedy for social and industrial unrest can hardly be admin- 
istered without taking into account the human factor. This new book treats 
ot the problem of education in its larger aspects as it is affected by the 
operation of the human factor in Society; in Industry; in Teaching; in 
Reconstruction. An inspiring reading circle book. 


EDUCATION AND THE GENERAL WELFARE . 


By Franx K-. Secuetst, Professor of Education, University of Cincinnati. 


A textbook of scho«al law, hygiene and management. whose central theme 
is the school as a part of community life and the individual child as the 
dominant interest of the school. Emphasis is laid on the conditions of learn- 
ing as distinguished from methods of teaching. 


PRINCIPLES OF SOCIOLOGY WITH EDUCATIONAL AP- 
PLICATIONS 


By Frepertck R. Crow, Teacher of History, Economics, and Sociology, 
State Normal School, Oshkosh, Wisconsin. 


Sociological theory in simple form for use as a tool in the analysis of the 
social situations which confront a teacher. Theory broad enough to suggest 
a philosophy of societv and of life. Text amplified with short selections that 
introduce the reader to the great sociologists of the present and the past. 
Intended for teachers or those in training to become teachers. 


The Macmillan Company. 


New York Boston Chicago 
Dallas Atlanta San Francisco 


George Banta Pudiishing Company, Menasha, Wisconsis 
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